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I.  INTRODUCTION 

P.cel  teedhack  on  systems  developed  at  the  Naval  Air  Development  Center  (NAVAIRDEVCEN)  has 
generated  an  increased  awareness  of  training  and  technical  maintenance  documentation  as  critical  factors  in 
system  design.  While  pursuing  goals  of  increased  system  performance,  it  is  recognized  that  any  actual 
pertormance  gains  must  be  filtered  through  the  maintenance  capability  of  the  average  fleet  technician. 
Chict  ot  Naval  Education  and  Training  (CNET'i  lias  suggested  that  training  costs  can  be  cut  by  making 
training  more  job  oriented  and  less  broad  and  theoretical,  especially  for  first  term  technicians.  Chief  of 
Naval  Personnel  (CHNAVPl.RS)  through  the  Personnel  Qualification  Standards  (PQS)  Program  has  been 
supporting  job  specific  On-The-Job  Training  (OJT).  The  PQS  will  specify  what  skills  are  required  for  a 
billet.  Naval  Air  Systems  Command  (NAVAIRX  AIR-04A4)  lias  been  sponsoring  research  for  improving  the 
effectiveness  ot  technical  documentation  to  support  the  technician  on  the  job.  The  Maintenance 
Information  Automated  Retiievul  System  (MIARS),  the  Technical  Review  and  Update  of  Manuals  and 
Publications  (TRUMP),  and  the  Work  Package  (WP)  concept  are  three  AIR-04A4  programs  aimed  at 
improvement  of  technical  documentation. 

These  programs  have  become  more  critical  with  the  advent  of  the  All-Volunteer  Force  (AVF).  The 
Navy  Enlisted  Occupational  Classification  System  (NEOCS)  study  predicted  a general  reduction  in  reading 
level  and  other  selection  test  scores  of  the  \VF.  Ami  more  recent  projections  indicate  that  due  to  the 
ueerea.se  in  the  number  of  people  in  the  19  to  2“  age  group  in  the  next  decade,  the  number  of  available  high 
aptitude  people  will  decrease.  In  addition,  weapon  systems  have  become  more  complex  and  as  a result, 
traditional  maintenance  training  programs,  which  have  always  required  high  aptitude  students,  have  become 
longer  and  more  costly.  In  spite  of  such  expensive  training,  there  is  substantial  evidence  which  indicates 
that  much  maintenance,  although  performed  effectively,  is  not  performed  efficiently  (Foley,  1475).  So 
ways  should  he  found  to  improve  the  quality  of  maintenance  but  with  maintenance  being  performed  by 
personnel  ot  somewhat  lower  aptitude  and  with  shorter  initial  training.  NAVAIR  is  charged  with  providing 
the  most  cos:  effective  training  support  and  technical  documentation  for  systems  and.  therefore,  must 
adopt  and/or  develop  approaches  to  cope  with  these  changing  Navy  needs  and  must  insure  that  these 
approaches  are  applied  to  systems  under  development  and  procurement. 

Fortunately,  the  Research  and  Development  (R&D)  establishments  of  atl  the  military'  services  have 
developed  and  demonstrated  the  potential  effectiveness  of  a number  of  relevant  training  models  and 
improved  maintenance  guidance  models,  as  well  as  combinations.  The  most  effective  improved  maintenance 
guidance  materials  have  reflected  important  aspects  of  the  Fully  Proceduralized  Job  Performance  Aid 
fFPJPA)  technology.  (Step-by -step  maintenance  instructions  in  standard  language,  supported  by  pictorial 
locators,  arc  essential  but  not  sufficient  identifying  elements  of  this  technology).  Six  previous  FPJPA 
projects  seemed  to  be  especially  applicable  to  a solution  of  many  Navy  maintenance  problems. 

Three  of  the  six  FPJPA  projects  applied  to  non-troubleshooting  (non-TS)  tasks  (such  as  checkout, 
align,  adjust.. calibrate,  and  remove  and  replace)  but  nor  to  troubleshooting  (TS)  tasks.  These  included  the 
Air  Force  project.  Presentation  of  Information  for  Maintenance  and  Operation  (PI MO)  (Serendipity.  1969). 
and  two  Navy  projects.  Advanced  Manpower  Concepts  for  Sea-based  Aviation  Systems  (AMSAS)  (Post  & 
Brooks.  Note  i)  and  Job  Performance  Aids  Test  (Horn.  Note  2).  These  projects  demonstrated  conclusively 
that  inexperienced  technicians  performing  with  Job  Guides  of  the  FPJPA  variety  could  perform  as  well  as 
or  better  than  experienced  personnel  performing  with  or  without  Job  Guides.  And  experienced  personnel 
made  fewer  maintenance  errors  when  performing  vvidt  Job  Guides  than  when  performing  in  their  traditional 
manner. 

A Joitrth  project,  a controlled  study  (sometimes  called  the  Twelve  Hour  Study)  of  the  Air  Force 
Human  Resources  Laboratory  (AFHRL)  ( Elliott.  1967.  Elliott  & Joyce,  19o8)  concerned  FPJPAs  for  TS. 
This  was  the  first  study  which  combined  the  FPJPA  and  job  (task)  oriented  training  (JOT)  technologies. 
Both  high  and  medium  aptitude  high  school  students  received  12  hours  of  specific  “hands  on"  training  on 
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(lie  use  ol  test  equipment  and  hand  tools.  These  subjects  performed  TS  tasks  as  well  as  did  the  experienced, 
nigh  aptitude  personnel  with  many  months  of  training.  These  high  school  subjects  used  FPJPAs  and  the 
experienced  technicians  used  traditional  maintenance  manual  (TMM)  materials.  Although  the  experiment  in 
this  study  was  controlled.  FPJPAs  were  not  developed  for  an  entire  system.  In  addition,  the  FPJPAs  used 
were  rather  primitive  by  current  standards. 

The  fifth  project  was  part  of  the  Vietnamization  program  and  concerned  the  development  of  FPJPAs 
for  both  non-TS  and  TS  tasks  for  ten  major  systems  or  subsystems.  fFor  a summary  of  this  effort,  see 
Foley.  19  <8a.)  Tliis  project  was  based  on  both  the  P1MO  and  the  AFHRL  efforts.  During  this  project,  a 
great  deal  was  learned  concerning  the  development  of  FPJPAs  by  contractors  not  familiar  with  the  concept. 
The  most  important  long-range  outcome  of  this  project  was  the  development  of  an  adequate  specification 
(Mi!-J-S3302)  and  guidance  handbooks  (Applied  Science  Associates.  1971a  & 1971b).  With  the 
development  ot  these  documents,  the  FPJPA  concept  emerged  as  a true  technology.  These  documents  were 
later  Americanized  and  published  as  a three-volume  technical  report.  AF11RL-TR-71-53  fFollcy  et  al., 
1971a.  1971b;  Joyce  et  al..  1971).  These  Americanized  documents  have  since  been  updated  and  published 
by  AFHRL  as  another  three -volume  technical  report.  AFHRL-TR-73-43  (Joyce  et  ai.,  1973a.  !973b. 
1973c).  The  characteristics  and  requirements  of  FPJPA  technology  arc  summarized  in  Figure  1. 

The  sixth  project  was  a 1972  AFHRL  demonstration  of  the  potential  effectiveness  of  combining 
FPJPAs  for  TS  tasks  and  JOT  at  Altus  Air  Force  Base  (Mullen  & Joyce.  1974).  The  FPJPAs  used  for  this 
demonstration  concerned  organizational  (0)  and  intermediate  (I)  level  maintenance  ol'  the  Doppler 
navigation  radar,  AN/APN-147,  and  its  computer.  AN/ASN-35.  These  FPJPAs  were  developed  prior  to  the 
development  o!  the  specification  and  guidance  handbooks.  A 4-week  JOT  program  concerning  non-TS 
tasks,  such  as  remove  and  replace  and  use  'if  test  equipment,  hand  tools,  anti  FPJPAs.  was  developed  for 
this  demonstration,  tight  high  electronic  aptitude  subjects  and  eight  medium  aptitude  subjects  were 
assigned,  immediately  after  completing  basic  training,  to  a job  oriented  4-week  course.  At  the  request  of 
NAVAIR,  the  author  observed  a segment  of  the  Altus  demonstration.  The  subjects  were  able  to  perform 
most  ol  the  typical  “0"  and  "1"  level  tasks  given  them.  Even  though  the  subjects  performed  reasonably 
well,  the  project  manager  indicated  that  he  believed  the  effectiveness  of  both  the  FPJPAs  and  the  JOT 
could  be  improved  by  the  development  of  FPJPAs  in  keeping  with  the  previously  mentioned  specification 
and  guidance  of  AFHRL-TR-71  -53  (Follev  ot  al..  1971a,  1971b;  Joyce  et  al..  1971)  and  by  adding  more 
task  practice  to  the  JOT.  But  despite  these  limitations  of  the  Altus  demonstration,  it  was  evident  to  the 
author  that  the  FFJPA  technology  represented  a coordinated,  as  well  as  a feasible,  approach  to  technical 
documentation.  In  addition,  this  demonstration  supported  the  hypothesis  that  a coordinated  FPJPA/JOT 
program  could  significantly  reduce  training  costs  while  improving  electronic  svstem  maintenance,  including 
TS. 

This  hypothesis  was  further  supported  by  an  independent  investigation  sponsored  by  the  Department 
ol  Detense  (DoD)  (Rowan.  1973).  In  this  investigation,  Rowan  concluded  that  non-TS  FPJPAs  or  job 
guides  coupled  with  JOT  have  received  sufficient  study  and  validation  to  support  their  adoption  by  DoD 
for  “0”  level  maintenance.  He  estimates  a saving  of  1.25  billion  dollars  annually  from  this 
recommendation,  ile  further  recommended  continued  testing,  citing  the  present  study,  to  determine 
whether  the  FPJPA  techniques  can  be  applied  to  ”0"  level  TS  and  ail  “f  level  maintenance  tasks.  Based  on 
the  hypothesis  that  the  FPJPA/JOT  combination  had  great  potential,  a demonstration, 'evaluation  was 
proposed  by  the  NAVAIRDEVCLN  to  ascertain  the  effectiveness  of  this  combination  for  both  TS  and 
non-TS  tasks  at  both  the  “0"  and  the  "I”  levels  of  maintenance.  The  proposal  was  made  to  the  Chief  of 
Naval  Operations  <CN0)  (OP-fo)  and  to  NAVAIR  (AIR-413.  AIR-04A4). 
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FPJPA  is  the  generic  name  cf  a technology  which  can  be  used  in  the  development  of  step-by-step  directions 
j for  both  non-troubleshooting  (non-TS)  and  troubleshooting  (TS)  tasks.  The  current  technology  contains  aspects 
obtained  from  several  sources,  including  the  AFhRL  exploratory  development  efforts,  the  first  AFHRL  advanced 
development  effort  (1967  — 72),  the  Presentation  of  Information  for  Maintenance  and  Operation  (PIMO)  project, 
and  JPA  projects  for  Vietnamization.  (The  12-hour  study  was  one  of  the  AFHRL  exploratory  efforts  and  the  Altus 
demonstration  was  part  of  the  first  AFHRL  advanced  development  effort.)  Currently.  AFHRL-TR-73-43,  a 
three-volume  technical  report,  provides  the  best  description  and  directions  concerning  the  FPJPA  technology  for 
both  non-TS  and  TS  tasks  (See  Joyce  et  al.,  1973a,  b,  and  c).  The  most  important  addition  to  this  report  is  found  in 
AFHRL-TR-75-38  (Shriver,  1975)  concerning  improved  cues  for  step-by-step  directions.  This  figure  is  a summary  of 
a description  of  the  FPJPA  technology  oy  Foley  (1978a).  The  technology  has  the  following  characteristics  and 
content. 

Task  Identification  and  Analyses  (TI&A)  of  Identified  Tasks  — A unique  characteristic  of  this  technology  is 
the  formal  requirement  for  the  development  and  use  of  TI&A.  To  ensure  the  effective  job  support  for  non-TS  by 
FPJPA,  an  aid  must  be  considered  for  every  task  of  a hardware  to  be  maintained.  This  requires  the  development  and 
use  of  a task  identif ication  matrix  (TIM).  Each  FPJPA  must  contain  accurate  and  complete  step-by-step 
instructions,  keyed  to  pictorial  locators  for  its  task.  And  each  FPJPA  must  contain  all  of  the  cues  necessary  for 
individuals  of  the  target  populations  to  perform  the  task.  FPJPA  for  TS  tasks  must  be  built  around  a logic  or 
troubleshooting  tree  that  identifies  all  the  troubleshooting  signatures.  There  must  be  a signature  for  each  replaceable 
component  assigned  to  the  level  of  maintenance  for  which  the  TS  aids  are  being  developed.  For  each  decision  point 
in  the  TS  tree,  accurate  step-by-step  instructions,  with  the  necessary  cues,  must  be  developed.  These  characteristics 
are  insured  by  the  development  and  application  of  a number  of  task  analysis  products  which  are  requried  by  the 
AFHRL-TR-73-43  specification.  To  ensure  the  completeness  and  adequacy  of  these  required  products  of  formal 
TI&A,  there  must  be  timely  periodic  m-process  reviews  and  official  acceptances  of  these  products  by  knowledgeable 
DoD  representatives.  These  products  then  become  criteria  for  the  structure  and  completeness  of  the  F°JPA  to  be 
used  during  their  development. 

Standard  Language  and  Keyed  Pictorials  for  Maintenance  Instructions  — Another  unique  characteristic  of 
FPJPA,  which  came  from  the  PIMO  project,  is  a standard  language.  Each  maintenance  direction  is  limited  to  a total 
of  three  sentences  and  a total  25  words.  Each  of  these  sentences  is  limited  to  10  words.  The  first  word  of  each 
sentence  is  an  action  verb  in  the  second  person  taken  from  a standard  verb  list.  In  addition  to  standard  verbs,  all 
nouns  are  cross-referenced  (keyea)  to  a locator  pictorial  which  indicates  to  the  user  the  appearance  of  the  item  and 
its  location  in  the  hardware.  This  standard  language  provision  coupled  with  the  pictorial  locators  reduce  the  reading 
requirements  of  the  user  to  a minimum. 

Format  — Using  TI&A,  standard  language,  3nd  keyed  pictorial  locators  for  content  determination  and 
considering  the  job  environment  in  which  the  identified  tasks  were  to  be  accomplished,  several  appropriate  formats 
have  been  developed  to  date.  But  it  is  important  to  remember  that  the  necessary  content  of  the  aids  is  far  more 
important  than  the  format.  A rormat  similar  to  that  developed  for  the  PIMO  project  has  usually  been  used  for 
ncn-TS  tasks  at  the  "0”  level  of  maintenance.  Instructions  have  been  formatted  in  a rather  small  booklet  with 
instructions  on  the  left-hand  page  and  the  locator  pictorials  on  the  right  hand.  Some  application-  have  provided 
pictorial  foldouts,  each  of  which  is  applied  to  more  than  one  p3ge  of  instructions.  There  have  been  two  formats  used 
for  FPJPA  for  TS  tasks:  one  in  which  the  instructions  have  been  placed  in  blocks  and  the  blocks  connected  by  flow 
lines  to  indicate  branching,  similar  to  Logic  Tree  Troubleshooting  Aids  (LTTA)  and  the  other  in  which  the 
instructions  have  been  placed  in  a scrambled  book.  The  scrambled  book  format  produces  a document  that  looks 
very  similar  to  FPJPA  for  non-TS  tasks.  The  branching  in  the  scrambled  book  is  provided  by  directions  to  go  to  the 
page  on  which  the  instructions  are  given.  Future  applications  of  the  FPJPA  technology  may  result  in  other  formats 
which  will  better  meet  the  needs  of  some  users.  The  point  is  that  the  FPJPA  technology  is  not  limited  by  format  nor 
is  it  truly  represented  by  format.  It  is  possible  to  apply  any  of  the  formats  mentioned  here,  without  the  content 
control  of  the  TI&A,  but  such  applications  cannot  legitimately  be  considered  true  implementations  of  the  FPJPA 
technology. 

Validation  and  Verification  - Validation  of  maintenance  manuals  by  the  contractor,  followed  by  verification 
by  the  appropriate  DoD  agency,  has  long  been  part  of  maintenance  policy.  In  some  cases  these  requirem  aits  involve 
only  table  top  inspections  of  the  final  products.  However,  in  the  past,  with  the  exception  of  corrections  for  obvious 
errors  in  directions  and  format,  little  could  be  accomplished  by  these  processes  to  insure  the  job  effectiveness  of 
maintenance  manuals.  Several  applications  of  the  FPJPA  technology  have  indicated  that  no  matter  how  carefully 
the  TI&A  was  accomplished  ana  monitored  and  no  matter  how  carefully  the  resulting  criteria  were  applied,  a very 
careful  "hands  on”  validation  and  verification  of  the  results  are  required.  For  maximum  effectiveness,  one  of  these 
efforts  should  include  "hands  on”  equipment  tryout  of  directions  by  members  of  the  target  populations  for  which 
•he  directions  have  been  developed.  Another  safeguard  which  was  applied  in  developing  aids  for  the  C-141  aircraft 
was  a three-year  warranty  by  the  contractor  of  his  product.  To  insure  maximum  effectiveness  of  the  FPJPA 
technology,  such  warranties  should  be  obtained  for  all  future  applications. 


Figure  1 . Characteristics  and  content  of  the  Fully  Proceduralized 
Job  Performance  Aids  (FPJPA)  technology. 

(This  t'lgurc  was  prepared  by  Dr.  John  P.  Foley  of  the 
Advanced  Systems  Division,  of  the  Air  Force 
Human  Resources  Laboratory. I 
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II.  TI1E  PROJECT  PLAN 

This  o t tort  was  planned  in  1972  as  a full  scale  controlled  study  to  determine  the  relative  effectiveness 
ot  the  combined  FPJPA  and  TOT  technologies  with  respect  to  traditional  theory  based  training  and  TMM. 
(I  ntortunately,  as  will  be  discussed  later,  the  controlled  comparative  aspects  of  this  plan  were  never 
completed.) 

The  formal  objective  of  the  project  was  to  test  whether  a 12-week  job  oriented  course,  when 
combined  with  FPJPAs,  could  prepare  recruit  training  graduates  with  45-52  scores  on  the  General 
Classification  Test  (GCT)  to  maintain  a typical  Navy  aircraft  electronic  subsystem  at  the  “O''  and  “I" 
levels.  Tire  project  would  differ  from  the  AFHRL  Altus  project  in  two  important  respects.  The  FPJPAs 
would  be  developed  in  keeping  with  tire  latest  version  of  the  specification  and  guidance  documents 
(AFHRL-TR-71-53.  Folley  et  al.,  l°71a.  1971b:  Joyce  et  al.,  1971).  The  JOT  developed  for  this  effort 
would  be  longer  than  the  Altus  JOT  and  would  thus  provide  more  job  task  practice.  Like  the  Altus 
program,  it  would  minimize  the  amount  of  traditional  theory.  During  the  planning  of  this  research  and 
development  (R&D),  close  coordination,  guidance,  and  support  w'as  provided  by  Dr.  John  P.  Folc\ . who 
was  at  that  time  directing  the  FPJPA  R&D  program  of  the  AFHRL.  Advanced  Systems  Division  at 
Wright-Pat  terson  .Air  Force  Base.  Puc  Altus  effort  was  part  of  this  AFHRL  FPJPA  program. 

The  Electronic  System  Selected 

The  AN/AQA-7  Sonar  Signal  Processing  System  was  selected  as  the  system  to  be  maintained  for  this 
project.  This  sonar  is  installed  in  the  S2G  and  P-3  series  aircraft.  It  was  selected  because  it  was 
representative  of  a state-of-the-art,  extremely  complex  electronics  system  containing  mostly  solid  state 
micro-electronics  components,  as  well  as  some  discrete  and  tube  components.  Tire  maintenance  concept  for 
the  "0"  level  consisted  primarily  in  TS  to  a “black  box"  level  or  large  card.  (TS  was  supported  by  a 
relatively  effective  Built-in  Test  Equipment  (BITE).) 

Although  it  changed  later,  at  the  time  of  its  selection  the  maintenance  concept  for  the  “I"  level  of 
maintenance  required  tecluiicians  to  TS  only  to  the  card  level  or  to  a discrete  component.  If  a card, 
identified  as  defective,  contained  a defective  integrated  circuit  or  chip,  the  card  was  sent  to  the  depot  level 
for  repair.  If  the  card  contained  only  discrete  components.  TS  continued  to  the  defective  component  witich 
was  replaced.  The  "1“  level  technician  was  required  to  use  the  following  test  equipment:  Digital  Voltmeter, 
Oscilloscope,  Differential  Voltmeter.  North  Atlantic  Phase  Meter,  and  Multimeter.  The  test  equipment  was 
incorporated  in  the  AWM-18,  AQM-20  test  bench. 

Presentation  and  Approval  of  the  Plan 

This  project  plan  was  presented  to  the  Chief  of  Naval  Education  and  Training  (CNET).  the  Chief  of 
Navy  Technical  Training  (CNTECHTRA)  and  tire  Naval  Aviation  Maintenance  Training  Group 
(NA.MTRAGRU).  With  their  concurrence  in  the  desirability  of  a test  of  the  project  goals.  CNO  (OP-59) 
issued  a message  directing  support  for  the  project.  CHNAVPERS  arranged  for  the  selection  of  40  volunteer 
recruits  to  participate  in  the  experimental  tryout.  CNTECHTRA  offered  his  assistance  in  evaluating  the 
JOT.  NA.MTRAGRU  provided  one  instructor  and  tiic  facilities  of  the  Naval  Air  Maintenance  Training 
Detachment  (NAMTRADET).  Cecil  Field.  Florida.  NAMTRADET  rescheduled  their  courses  with  the 
cooperation  ot  Air  .Anti-Submarine  Wing  (COMAIRASW1NG)  ONE.  Cecil  Field,  to  make  classroom  spaces 
and  equipment  available  for  the  development  ot  the  FPJPAs  and  for  use  in  the  training  course.  The 
Commander,  Patrol  Squadion  40  (PATRON  FOUR  NINE)  provided  two  additional  instructors  for  use  in 
the  administration  of  die  training. 

The  coordination  of  these  many  commands  was  facilitated  by  their  enthusiastic  attitude  toward 
innovation  and  their  awareness  of  the  problems  faced  in  the  AVF.  It  was  recognized  that  the  results  of  the 
present  study,  it  suecesslul.  would  suggest  the  elimination  of  broad  theoretical  training  being  given  at  “A" 
school  and  modification  of  the  JOT  presently  givenJKt  NAMTRADETS.  Trainees,  lacking  die  broad 


4 


r 


NADC-7  8286-60 


dieoretical  training,  would  be  at  a great  disadvantage  in  competing  in  the  present  Navy  advancement 
examinations.  Therefore,  the  introduction  ot  FPJPA/JOT  would  require  coordinated  chances  in  these 
examinations.  However,  in  briefings  on  this  project  provided  to  the  NEOCS  director,  it  was  noted  that 
NEOCS  planned  changes  which  will  allow  the  Navy'  advancement  system  to  accommodate  first  enlistment 
sailors  who  had  received  JOT  rather  titan  the  traditional  theory  based  training. 


111.  DEVELOPMENT  OF  FPJPA/JOT 

The  FPJPAs  for  the  AN/AQA-7  were  developed  in  accordance  with  the  then  latest  version  of  the 
FPJPA  specification  and  guidance  documents  presented  in  the  three  volume  AFHRL-TR-71 -53  (Folley  et 
al..  1971a.  1971b;  Joyce  et  ah.  1970  mentioned  previously.  These  aids  were  developed  in  two  contractual 
steps  at  the  suggestion  ot  Dr.  Foley  of  AFHRL.  The  first  step  was  the  development  of  a task  identification 
matrix  (TIM)  tor  the  AN/AQA-7  and  a sample  FPJPA.  The  TIM  ascertained  the  number  and  type  of  tasks 
tor  which  FPJPAs  should  be  prepared  and  thus  described  the  scope  and  magnitude  of  the  FPJPA  production 
effort.  This  work  was  accomplished  by  a S69 ,000  sole  source  contract  with  Applied  Science  Associates.  Inc. 
(ASA)  of  Valencia.  Pennsylvania,  the  contractor  who  had  developed  AFHRL-TR-71-53.  specification  and 
guidance  documents  (Folley  et  al.,  1971a,  1971b;  Joyce  et  al..  19711.  This  TIM  and  sample  FPJPA  formed 
the  bases  tor  a request  for  bid  (RFB)  for  the  second  contractual  step,  a multi-source  procurement  for  the 
production  ot  the  FPJPA.  Two  contractors  submitted  proposals  which  were  rated  by  representatives  of 
NAVAIR  (A1R413  and  A1R-04A4).  On  the  basis  of  these  ratings  followed  up  by  on-site  discussions  with" 
management  personnel,  ASA  was  awarded  the  S292.000  production  contract. 

The  services  ot  a technical  representative  of  the  manufacturer  of  the  AN/AQA-7  (Magnavox)  were 
obtained  to  provide  for  quality  assurance  on  maintenance  procedures.  All  drafts  of  TS  and  non-TS 
procedures  were  reviewed  tor  effectiveness  and  signed  bv  this  Magnavox  representative.  This  service  cost 
S 25,000. 

Based  on  another  multi-source  procurement,  a SI  12,000  contract  for  the  development  of  tire  JOT 
materials  was  awarded  to  ASA.  Key  personnel  of  this  organization  had  extensive  R&D  experience  in  both 
FPJPA  and  JOT  technologies;  this  firm  had  conducted  all  of  the  AFHRL  contract  exploratory  development 
concerning  FPJPAs.  had  developed  the  FPJPA  specification  Mil-J -83302  and  its  two  guidance  documents 
(Applied  Science  Associates,  H'Tia.  1971b),  and  had  conducted  an  extensive  AFHRL  JOT  program  called 
Learner-Centered  Instruction  (LCD  (Pieper.  Swezey.  & Valverde.  1970).  In  addition,  ASA  bad  developed 
both  the  FPJPAs  and  matching  JOT  tor  the  Altus  AFB  demonstration  and  had  conducted  that 
demonstration  (Mullen  & Joyce.  1974).  Such  extensive  experience  had  uniquely  qualified  this  contractor  to 
integrate  the  JOT  with  the  FPJPAs.  As  a result,  a good  match  between  the  FPJPAs  and  the  JOT  was 
achieved.  (However,  as  will  be  discussed  later,  problems  were  encountered  concerning  timely  delivery.) 

The  goals  of  the  training  program  were  to  reduce  the  theoretical  content  to  an  absolute  minimum,  to 
use  programmed  instruction  as  much  as  possible,  and  to  introduce  the  subject  to  the  use  of  FPJPA-likc 
materials  as  early  as  possible.  Since  one  ot  the  major  problems  cited  by  the  researchers  at  Altus  AFB  was 
insulficicnt  task  practice  — the  training  was  to  provide  as  much  practice  as  possible  within  a 12-week 
course.  The  JOT  packages  ultimately  developed,  based  on  the  TIM.  were  somewhat  longer.  The  package  for 
the  O level  program  required  13  weeks;  tor  the  "I”  level.  16  weeks.  Appendix  A authored  by  Thomas  K. 
Elliott  of  ASA  provides  a detailed  discussion  of  die  procedures  used  to  develop  both  die  FPJPAs  and  the 
relevant  JOT.  This  material  should  be  “must"  reading  for  anyone  planning  for  or  developing  JOT  and/or 
FPJPA  efforts. 

The  standard  pipeline  lor  maintenance  ot  the  AN/AQA-7  required  approximately  22  weeks  of 
training  for  qualification  in  the  AX  rating,  followed  by  2 weeks  of  “O"  level  and  14  weeks  of  “1"  level 
training  in  the  NAMTRADET,  for  a total  of  24  weeks  for  "0”  level  and  36  weeks  for  “1"  level.  When 
compared  to  the  standard  24  week  “O  ’ level  program,  the  13  week  ''O”  level  JOT  represents  a 45.8  percent 
reduction  in  training  time.  When  compared  to  the  standard  36  week  “1"  level  program,  the  16  week  “1" 
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level  JOT  represents  a 55.5  percent  reduction  in  training  time.  Thus,  the  FPJPA  JOT  program  time  and 
costs  are  significantly  lower  than  that  ot  the  '’A"  and  “C"  school  graduate  who  normally  performs  the  same 
functions. 


IV.  CONDUCT  AND  EVALU  ATION  OF  TIIE  TRAINING  PROGRAMS 

The  original  plan  lor  the  conduct  of  training  was  based  on  the  following  assumptions: 

1.  There  would  be  tour  instructors:  two  to  teach  “I"  level  maintenance  and  two  to  teach  “0"  level 
maintenance. 

2.  The  subjects  would  arrive  in  four  groups  of  10  each  approximately  1 to  2 weeks  apart. 

5.  Two  AN/AQA-7  systems  and  two  AQM-18  test  benches  could  be  made  available  for  the  exclusive 
use  of  the  project. 

4.  Access  to  S2G  aircraft  (with  operating  AQA-7s)  could  be  obtained. 

Unfortunately,  none  of  these  conditions  were  met. 

Instructors 

Three  instead  of  tour  instructors  were  obtained.  Those  obtained,  however,  were  senior  Naw  enlisted 
technicians.  The  Otficer-in -Charge  ot  the  Naval  Air  Maintenance  Training  Detachment  (NAMTDET)  at  Cecil 
Field  provided  AWC  Robert  Henry,  lie  had  previously  instructed  "A"  school  graduates  in  the  repair  of  site 
AN/AQA-7  and  was  a graduate  of  Navy  instructor  school.  PATRON  FOUR  NINE  provided  two  additional 
experienced  AN/AQA-7  operators,  both  with  experience  in  the  operation  and  maintenance  of  the 
AN/AQA-7:  AWC  Tom  Pope  and  AWI  James  Moore. 


Subjects 

Although  the  desired  number  of  subjects,  4i.  with  the  proper  aptitudes,  were  assigned  to  die  pioieet 
by  CHNAVPF.RS,  they  arrived  early  and  all  in  one  group  instead  of  four.  These  were  volunteers  whose 
selection  test  scores  were  below  the  cutoff  for  eligibility  to  "A”  school  (GCT+  AR1  + MUCH  = 170).  The 
following  test  scores  were  stipulated:  GCT  45-52.  ARI  45  -52,  MECH  45-52  with  GCT  + AR1  + MECH  = 
■40  to  150.  This  composite  placed  t lie  subjects’  aptitudes  for  electronics  training  in  approximately  the  40 
to  50  percentile  range. 

Equipment  Availability 

Instead  ot  the  planned  two  AN/AQA-7  systems  and  two  AN/AQM-18  test  benches,  only  one  of  each 
was  obtained.  And  due  to  the  heavy  flight  commitments  of  CO.MAIRASW1NG  ONE.  access  toS2G  aircraft 
was  limited. 

JOT  Materials 

As  mentioned  previously,  the  JOT  materials  were  delivered  approximately  1 month  late  and  not 
properly  collated.  This  late  delivery  was  not  anticipated  in  sufficient  time  to  delay  the  arrival  of  the 
subjects.  In  addition,  the  departure  of  the  subjects  could  not  be  delayed. 

Modified  Plan  of  Instruction 

While  the  subjects  were  waiting  for  the  JOT  materials  to  be  delivered,  they  were  given  ceneral 
background  courses  on  Naval  aviation  and  the  3-M  maintenance  system.  It  was  also  decided  to  use  the 
standard  2-wock  miniature  component  repair  course  to  teach  'soldering.  This  decision  was  taken  with  tiie 
understanding  that  the  trainees  lacked  familiarity  with  the  normal  prerequisites  for  the  miniature 
component  repair  course.  However,  it  they  successfully  completed  this  course,  they  could  later  attend  the 
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micro-miniature  repair  course  and  obtain  certification  as  micro-miniature  repairmen.  These  improvisations 
provided  tite  time  needed  to  deliver  the  JOT  packages. 

After  delivery  and  assembly  of  the  training  materials,  the  4!  trainees  were  divided  into  three  sections, 
two  sections  of  13  trainees  each  were  assigned  to  “1"  level  training  and  one  section  of  15  trainees  was 
assigned  to  “0”  level  training.  (Of  those,  three  "0"  level  and  three  “I"  level  subjects  were  dismissed  from 
the  project  for  non-academic  reasons.  As  a result.  12  "0”  level  and  23  “1“  level  subjects  completed  training 
and  were  utilized  in  the  experimental  tryout  of  die  FPJPAs.)  Since  only  one  AVAQA-7  and  AN/AQM-18 
test  bench  could  be  made  available  for  instruction,  it  was  decided  to  establisii  a 24-hour  teaching  day 
consisting  of  three  8-hour  sessions.  Sessions  were  scheduled  Monday  through  Thursday  to  conform  with  the 
normal  NAS  Cecil  Field  work  week.  Arrangements  were  made  with  the  Aviation  intermediate  Maintenance 
Department  of  NAS  Cecil  Field  to  obtain  priority  repairs  to  the  AN/AQA-7  components  used  in  training. 
Despite  this  excellent  support,  however,  many  training  hours  were  irretrievably  lost  due  to  equipment  being 
inoperative  for  maintenance. 


Evaluative  Statement  Concerning  Training 

Under  these  circumstances,  the  full  potential  of  the  JOT  could  not  be  realized.  The  reduced  number 
of  instructors  and  the  larger  than  planned  class  sizes  reduced  the  amount  of  individual  attention  each 
subject  could  receive.  The  time  allowed  for  the  JOT  program  was  shorter  than  planned,  which  reduced  tite 
opportunities  for  subjects  to  receive  the  planned  amount  of  “hands  on”  task  practice.  These  opportunities 
were  further  reduced  by  insufficient  availability  of  equipment.  Even  with  all  these  violations  of  the  training 
ground  rules,  tite  JOT  program  was  reasonably  effective.  Tite  omission  of  training  on  tite  dual  beam  feature 
of  the  oscilloscope  was  its  only  major  deficiency.  More  detailed  information  concerning  the  quality  of  the 
training  materials,  the  conduct  of  tite  training  and  the  students'  attitudes  toward  the  training  arc  presented 
in  Appendix  B.  Tins  appendix  was  prepared  by  Lt  Robert  P.  Fisitburne.  who  was  assigned  to  this  project  by 
RADM  Albert  M.  Sackett.  Chief  of  Naval  Technical  Training,  CNTT. 


V.  EVALUATIVE  TRYOUT  OF  FPJPAs 


Problem  Selection 

Tite  evaluation  of  the  subjects'  ability  to  perform  job  tasks  using  FPJPAs  sought  to  provide  as  realistic 
as  practicable  a work  setting  with  representative  maintenance  problems.  However,  in  order  to  gather 
adequate  samples  of  data,  problems  were  selected  which  could  be  solved  in  approximately  50  minutes  using 
the  FPJPAs.  Discussion  were  hold  with  the  N.A.S.  Cecil  Field  Intermediate  Maintenance  Activity,  the 
Magnavox  representative,  and  tite  N’WESA  Field  engineers.  Problems  were  selected  which  had  high 
frequency  of  occurrence  as  reported  on  3M  data.  Each  problem  was  then  “solved”  using  the  FPJPA 
procedures.  In  four  cases  the  problems  took  longer  than  50  minutes.  In  those  cases  the  problem  was 
shortened  by  starting  the  evaluation  with  “set  up"  and  checkout  steps  already  completed.  Tite  sic-s 
eliminated  were  usually  just  equipment  warm-up  tests  or  switch  setting  steps,  and  in  no  case  did  these 
eliminations  result  in  a simplifying  of  the  problem  for  the  subject.  Tite  data  collection  had  to  be 
accomplished  in  4 weeks  because  the  equipment  and  subjects  had  to  be  released  ai  that  time.  It  was  oniy 
possible  to  administer  five  problems  to  eaclt  of  the  1 2 “O"  level  subjects  and  four  problems  to  each  of  the 
23  "I”  level  subjects.  It  would  have  been  desirable  to  obtain  data  for  a larger  number  of  problems:  however, 
the  problems  selected  are  considered  representative. 

Criteria  for  Successful  Task  Performance 

Tire  basic  measure  of  human  performance  used  in  this  evaluative  tryout  was  in  terms  of  acceptable 
products.  Eacit  desired  product  was  the  successful  contplctioh  of  a maintenance  task  without  assistance. 
TIi is  was  a go.  no-go  criterion.  Die  resulting  product  data  are  presented  in  terms  of  percentage  of  such  tasks 
completed.  In  'lie  real  world  of  maintenance,  correct  performance  of  maintenance  tasks  is  not  always 
obtained  on  tite  first  attempt,  but  efficiency  demands  such  performance  as  a goal. 
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Time  data  were  also  obtained  for  each  task  and  are  presented  in  terms  of  mean  time  for  tasks 
successfully  completed.  Tire  time  required  to  perform  a maintenance  task  correctly  is  seldom  critical  11  the 
“1"  level  of  maintenance  provided  it  is  performed  in  a reasonable  time.  But  under  some  circumstances,  time 
available  tor  accomplishing  such  correct  performance  is  limited  and/or  critical.  The  eircunstances,  where 
speed  ot  performance  becomes  critical,  are  usually  found  at  the  “0”  level  of  maintenance.  Examples 
include,  (a)  the  requirement  for  correction  of  system  malfunctions  discovered  during  preflight  checkouts, 
(b)  situations  where  turnaround  time  of  aircraft  is  critical,  and  (c)  power  plant  failures  which  cause 
electrical  outages.  Normally  when  speed  is  a critical  aspect  of  task  performance,  it  should  be  made  part  of 
the  go,  no-go  criterion,  i.e.,  the  subject  should  be  able  to  perform  the  task  successfully  within  the  critical 
time  limn.  However,  for  evaluative  tryouts  such  as  this  one.  time  factors  have  not  been  included  in  the  go. 
no-go  criteria  tor  successful  completion  of  tasks. 

Since  the  success  of  performance  is  aiwavs  a prime  requirement,  task  success  data  were  the  primary 
criteria  for  this  evaluative  tryout  and  are  presented  first  in  the  presentation  and  discussion  of  results.  (As 
was  discussed  previously,  the  time  to  perform  a task  using  FPJPA  was  an  important  consideration  in 
selection  of  tasks  for  this  evaluation  due  to  scheduling  factors.) 

Data  Collection 

The  data  were  collected  over  a 4-week  period.  Each  day  consisted  of  8 to  1 1. 50-minute  sessions  and 
each  subject  was  tested  at  the  rate  of  one  session  per  day  for  5 ("0"  level)  or  4 (“I"  level)  consecutive  days. 
Prior  to  the  beginning  of  each  day's  sessions,  the  system  was  checked  by  the  Maenavox  representative,  and 
the  problem  selected  for  that  day  was  inserted  in  the  system.  The  same  problem  was  used  for  all  sessions 
during  any  1 day. 

NWESA  field  engineers  had  been  assigned  tire  task  of  data  collection  for  two  reasons:  fa)  they  had 
previous  experience  with  JPA  evaluations  and  (b)  they  could  serve  as  objective,  unbiased  observers  since 
they  had  not  been  involved  in  the  earlier  portions  of  (he  evaluation. 

Each  subject  was  instructed,  at  the  beginning  of  a session,  as  to  his  entry  step  for  the  problem.  If  this 
step  was  not  step  1 in  his  book,  it  was  explained  that  all  previous  steps  had  been  completed  and  that  the 
system  was  checked  to  the  entr>  step  that  he  was  given.  Initial  planning  called  for  no  help  to  be  provided  to 
the  subjects:  data  collectors  merely  recorded  the  steps  taken  by  the  trainee.  This  rule  was  slightly  modified 
so  that  if  the  subject  went  off  on  a completely  erroneous  tangent,  he  would  be  stopped,  told  to  leave  the 
room,  and  be  brought  back  in  a few  minutes  to  try  the  problem  one  more  time. 

Results 

Table  1 presents  the  data  concerning  the  successful  completion  of  "0”  level  TS  problems  selected  for 
the  evaluative  tryout. 


Table  l.  Task  Success  of  1 2 Medium  Aptitude  Navy  Subjects  (40-50  Percentile) 
Using  FPJPA  for  Organizational  (O)  Level  Troubleshooting  Tasks 


Problem 

identification 

Percent  of  Problems 

Successfully  Completed 

Mean  Time 
Required  in  Minutes 

X 

SO 

19A2 

00.5 

35.8 

12.0 

20  A- 1 

91.1 

17.6 

5.6 

1 \1 

07.1 

47.0 

2.8 

4A2 

57.5J 

21.8 

6.6 

FMS=2 

47.9 

51.0 

21.2 

Composite  of  “0"  Level: 

86.6 

''Problem  required  cacti  subject  to  use  the  du.il  hc.im  ’.attire  or  the  oscilloscope.  Subjects  had  received  r.o  training 
concerning  this  feature  of  the  scope. 
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It  should  be  noted  that  the  five  "0"  level  problems  were  all  TS  problems.  With  the  exception  of  the 
4.A2  problem,  all  of  the  percentages  were  over  90  percent.  As  indicated  in  Table  1 , the  primary  cause  of  the 
57.5  percent  results  for  problem  4A2  must  be  attributed  to  a training  weakness.  The  subjects  had  received 
no  training  on  the  use  of  the  dual  beam  feature  of  the  oscilloscope.  The  composite  figure  for  “0”  level  TS 
performance  including  the  4A2  problem  was  86.6  percent;  excluding  the  4A2  problem,  93.9  percent.  Time 
data  concerning  these  “0”  level  problems  are  indicated  in  the  third  and  fourth  columns  of  Table  1 . 

Table  2 presents  the  data  concerning  the  successful  completion  of  “I"  level  problems  by  23  subjects. 


Tabic  2.  Task  Success  of  23  Medium  Aptitude  Subjects  (40-50  Percentile) 
Using  FPJPA  for  Intermediate  (I)  Level  Tasks 


Problem 

Identification 

Non-TS 

TS 

Percent  of  Problems 
Successfully  Completed 

Mean  Time 
Required 
in  Minutes 

X 

SD 

6A4 

X 

X 

84.4 

50.2 

1 1.6 

PP6306 

X 

93.7 

37.8 

11.3 

4A2 

X (Align) 

68.2* 

49.1 

21.3 

11  A3 

X (Align) 

82.5 

51.6 

13.0 

Composite  TS  Problems 

89.1 

Composite  Non-TS  Problems 

75.4 

Composite  ’T'  Level 

84.1 

‘H'toblem  required  each  subject  to  use  the  dual  beam  feature  of  the  oscilloscope.  Subjects  had  received  no  training 
concerning  this  feature  of  the  scope. 


As  to  the  two  TS  problems,  the  6A4  problem  was  more  complex  than  the  PP6302  problem.  The  6A4 
TS  task  added  the  clutter  of  the  non-TS  elements  of  adjustment  and  of  the  use  of  the  oscilloscope.  Tit  is 
complexity  was  reflected  in  the  results:  84.4  percent  success  for  the  6A4  task  compared  to  93.7  success  for 
the  PP6306  task.  In  the  writer’s  opinion,  the  6A4  task  was  more  representative  of  "I”  level  TS  tasks, 
generally,  then  the  simpler  PP6306  task.  The  composite  for  the  two  TS  tasks  was  89.1  percent. 

As  to  the  non-TS  alignment  tasks  4A2  and  1 1A3,  the  82.5  percent  success  rate  for  the  1 1A3 
alignment  task  was  higher  than  the  rate  for  4\2  alignment  task  but  lower  than  any  of  the  “0”  or  "I"  level 
FS  tasks  except  the  4A2  ”0"  level  TS  task.  The  low  4A2  alignment  performance  (68.2  percent)  reflected 
the  same  training  omission  of  the  dual  beam  feature  of  the  oscilloscope  as  did  the  4A2  “0"  level  TS 
performance.  Time  data  for  these  “I"  level  problems  arc  indicated  in  the  fifth  and  sixth  columns  of  Table  2. 

A number  of  key  questions  should  be  answered  concerning  the  relative  effectiveness  of  the  task 
performance  ot  those  medium  aptitude  Navy  subjects  using  FPJPA  who  received  only  13  or  16  weeks  of 
JOT.  such  as  how  do  the  results  for  these  medium  aptitude  subjects  compare  with: 

1-  The  performance  of  current  experienced  Navy  personnel  using  TMM  who  now  maintain  the 
AN/AOA-7?  (These  are  high  aptitude  personnel  who  have  received  much  longer  training  - 24  weeks  for 
"0”  level  and  36  weeks  for  "1"  level.) 

2.  The  performance  of  such  experienced  Navy  technicians  using  FPJPAsI 

3.  The  performance  of  inexperienced,  high  aptitude  Navy  personnel  using  FPJPAs  who  have 
completed  the  current  long  training? 

4.  The  performance  of  both  experienced  and  inexperienced  high  aptitude  personnel  using  FPJPAs 
who  have  completed  the  shorter  JOT  programs  instead  of  the  longer  current  training? 
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Answers  to  such  pertinent  questions  would  have  been  provided  by  the  data  from  the  originally 
planned  lull  scale  controlled  study.  Due  to  funding  problems,  such  data  were  never  collected.  However,  in 
the  absence  of  these  more  desirable  data,  answers  to  some  of  these  questions  can  be  obtained  by 
substituting  applicable  control  and  experimental  data  from  an  AFHRL  study  (Potter  & Thomas.  1 976).  In 
addition  some  relevant  data  arc  available  from  a less  extensive  Air  Force  study  (Elliott,  1967.  Elliott  & 
Joyce,  1968),  sometimes  called  the  “Twelve  Hour  Study."  The  scope  of  these  AFHRL  studies  was  limited 
to  the  etfectiveness  of  the  FPJPA  technology  for  supporting  the  performance  of  TS  rusks.  They  did  not 
study  the  effects  of  FPJPAs  on  non-TS  tasks  per  se. 


VI.  COMPARISON  OF  RESULTS  WITH  OTHER  FPJPA  STUDIES 

The  appropriateness  for  comparing  the  data  from  this  NADC  evaluative  tryout  with  control  and 
experimental  data  from  the  AFHRL  Advanced  Development  Study  (Potter  & Thomas,  1976)  is  based  on 
four  assumptions: 

1.  The  training  received  by  the  experienced  high  aptitude  Navy  AN/AQA-7  system  technicians  and 
the  Air  Force  AN/APN-147-AN/ASN-35  system  technicians  were  reasonably  equivalent. 

2.  Die  TS  tasks  demanded  by  the  AN/AQA-7  system  and  the  AN/APN-I47-AN/ASN-3S  system 
were  of  equivalent  complexity. 

3.  As  a result  of  assumptions  I and  2.  the  TS  capabilities  of  the  Navy  and  Air  Force  technician  to 
perform  TS  were  also  reasonably  equivalent. 

4.  The  FPJPAs  lor  TS  for  the  AN/AQA-7  system  and  the  AN/APN-I47-AN/ASN-35  system  are  of 
equivalent  effectiveness. 

Training  Equivalence 

As  indicated  previously,  the  standard  formal  training  for  Navy  AN/AQA-7  technician  requires 
approximately  22  weeks  of  basic  electronic  fundamentals  training  for  qualification  in  the  AX  rating 
followed  by  2 weeks  of  AN/AQA-7  task  specific  training  for  the  "0“  level  of  maintenance  and  by  14  weeks 
of  AN/AQA-7  task  specific  training  for  the  "1“  level.  These  times  make  a total  of  24  weeks  for  the  "0” 
level  and  36  weeks  for  the  “I”  level.  The  standard  formal  training  required  for  both  "0"  and  “1“  Air  Force 
technicians  maintaining  the  AN/APN-147-AN/ASN-35  system  was  36  weeks.  This  included  18  weeks  of 
basic  electronic  fundamentals  and  18  weeks  of  theory  oriented  training  on  four  representative  electronic 
systems,  one  of  which  was  the  AN/APN-l47-AN/ASN-3<  system.  The  AN/APN-1 47-AN/ASN-35 
technicians  received  their  task  specific  "O"  and/or  “I"  level  training  by  OJT  after  job  assignment.  So  it  is  a 
reasonable  assumption  that  after  6 months  experience  on  the  job  '.lie  TS  performance  capabilities  using 
TMM  for  such  Air  Force  and  Navy  technicians  would  be  comparable. 

Comparison  of  TS  Task  Complexity 

From  the  stand  point  of  electronic  complexity,  the  Navy  AN/AQA-7  Sonar  used  in  this  NADC  study 
is  more  complex  than  the  Air  Force  AN/APN-147  and  its  computer,  the  AN/ASN-35.  Since  “0“  level 
maintenance  was  only  concerned  with  Line  Replaceable  Units  (LRUs),  this  difference  in  t'lectronic 
complexity  would  have  had  little  or  no  effect  on  the  TS  tasks  at  the  “0"  level.  The  maintenance  concept 
and  complexity  of  TS  tasks  when  performed  with  TMMs  at  the  “0"  level  are  considered  to  be  comparable. 

As  to  the  “I”  level  of  maintenance,  the  differences  in  difficulty  of  solving  TS  problems  with  TMMs 
between  the  AN/APN-147-AN/ASN-35  system  (used  in  the  AFHRL  Advanced  Development  Study)  and  the 
Navy  AN/AQA-7  is  riot  too  great.  Even  though  the  electronic  complexity  of  the  AN/AQA-7  was  greater 
than  that  ot  the  AN/APN-147-AN/ASN-35.  their  “I"  level  maintenance  concepts  were  different.  Since  the 
Shop  Replaceable  Units  (SRUs)  for  the  AP/APN-147-AN/ASN-35  system  included  the  smallest  piece  parts. 
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the  complexity  of  TS  with  TMMs  at  the  "I"  reflected  the  full  complexity  of  the  hardware.  Whereas,  the 
complexity  or  TS  with  TMMs  for  the  AN/AQA-7  did  not  reflect  its  full  electronic  complexity  since  most  of 
the  SRUs  for  this  system  were  circuit  boards,  at  the  time  this  NADC  evaluative  iryou!  was  approved.  (This 
1 level  maintenance  concept  tor  the  ANVAQA-7  was  later  expanded.  At  least  some  circuit  board 
components  were  designated  as  SRUs.  But  these  changes  were  not  reflected  in  this  evaluative  try  out  .1 

Equivalence  of  FPJPAs 

Since  the  FPJPAs  used  for  solving  TS  problems  in  the  NADC  effort  and  for  the  AFHRL  Advanced 
Development  Study  were  both  developed  in  keeping  with  the  FPJPA  technology  described  in  Figure  1. 
these  FPJPA  are  considered  to  be  equally  good  representatives  of  the  technology  and  of  comparable 
quality.  (The  degree  to  which  the  AN/AQA-7  FPJPAs  reflect  the  FPJPA  technology  is  discussed  in  the  next 
section  of  this  report.)  As  a result,  the  FPJPAs  used  in  the  two  efforts  are  considered  to  he  of  equivalent 
effectiveness. 

A Word  Concerning  the  AFHRL  Twelve  Hour  Study 

Although  data  from  the  AFHRL  Twelve  Hour  Study  (Elliott.  1967;  Elliott  & Joyce.  1968)  arc  also 
included  in  the  comparative  analyses  that  fellow,  the  equivalency  between  this  AFHRL  study  and  the 
NADC  evaluative  tryout  is  not  as  great  as  the  equivalency  between  AFHRL  Advanced  Development  Study 
and  the  NADC  evaluative  try  out.  The  FPJPAs  used  were  the  first  such  aids  developed  for  TS  and  were 
rather  primitive  examples  of  the  FPJPA  technology.  The  experimental  subiects  were  both  medium  and  high 
aptitude,  high  school  student,  who  had  received  only  12  hours  of  JOT  instead  of  13  or  16  weeks  as  in  the 
N ADC  evaluative  tryout.  However,  the  control  subjects  who  performed  TS  with  TMMs  were  highly  trained 
and  experienced  Air  Force  technicians  who  were  probably  equivalent  in  TS  capability  to  the  control 
subjects  of  the  Advanced  Development  Study  or  to  experienced  Navy  AN/AQA-7  technicians. 

Piesentation  and  Scope  of  Comparative  Data 

Tables  3 and  4 present  composite  FS  data  in  terms  of  percent  of  faults  isolated  for  “0”  and  “l”  level 
maintenance,  respectively. 

Tabic  3.  Comparison  of  the  TS  Performance  in  Percent  of  “0”  Level  Faults 
Isolated  by  Medium  Aptitude  Inexperienced  Navy  Subjects  with  the  Performance 
of  Control  and  Experimental  Subjects  in  a Comparable  Air  Force 
Advanced  Development  Study 


TMM  Control 

Group  AFHRL 

Adv  Oev  Study 

Type  of  Subjects 

FPJPA  Experimental  Groups 

AFHRL  Adv  Dtv  Study  Navy  NADC  Tryout 

100’ 

High  Aptitude 

More  than  6 mo  experience 

9S.8 

100’ 

6 mo  or  less  experience 

100 

— 

— 

Inexperienced 

S8.9 

- 

- 

Medium  Aptitude 

Inexperienced 

- 

93.9  (86.6)b 

’Subject  permirted  to  remove  and  replace  Line  Replaceable  Units  (LRU)  until  faults  were  isolated. 

^The  86.6  percent  tigurc  is  the  composite  figure  from  Table  1.  The  93.9  figure  excludes  problem  4A2  which  rcow.rcd 
the  use  .(  the  dual  beam  feature  •»!  the  oscilloscope.  Subjects  had  received  no  training  on  this  feature. 
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Table  4.  Comparison  of  the  IS  Performance  in  Percent  of  “T*  Level  Faults 
Isolated  by  Medium  Aptitude  Inexperienced  Navy  Subjects  with  Performance 
of  Control  and  Experimental  Subjects  in  Air  Force  Studies 


TMM  Control  Groups 

FPJPA  Experimental  Groups 

AFHRL 

12  Hour 

Study 

AFHRL 

Adv  Dev 

Study 

Type  of  Subjects 

AFHRL 
1 2 Hour 
Study 

AFHRL 

Adv  Dev 

Study 

Navy 
NAOC 
T ryout 

S4.2 

78.  Sa 

High  Aptitude 

More  than  6 mo  experience 

95.4 

- 

60. 6'1 

6 mo  or  less  experience 

- 

95.4 

— 

- 

Inexperienced 

93.0 

88.8 

- 

- 

- 

Medium  Aptitude 

Inexperienced 

82.0 

- 

89. 1 

‘‘Subjects  permitted  to  remove  .irul  replace  Simp  Replaceable  Units  SRU)  until  faults  were  isolated. 
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Performance  success  data  for  nou-TS  '.asks  are  not  included  since  all  of  the  tasks  utilized  in  the 
AFHRL  Advanced  Development  Study  and  in  the  Twelve  Hour  Study  were  TS  tasks  and  the  NADC 
evaluative  tryout  used  only  two  non-TS  tasks  at  the  "I"  level  and  no  non-TS  tasks  at  the  "0”  level.  TS  data 
for  both  control  and  experimental  groups  from  these  studies  are  included.  These  tables  include  onlv 
experimental  group  data  for  this  Navy  evaluative  tryout. 

Intermediate  ( 1)  Level  Results 

An  examination  of  Tables  3 and  4 indicates  that  die  most  impressive  improvement  in  TS  success  from 
■isc  of  FPJPAs  are  obtained  at  the  “I"  level  of  maintenance.  Table  4 indicates  that  the  medium  aptitude  (40 
to  50  percentile)  Navy  subjects  with  16  weeks  of  less  than  ideal  JOT  obtained  a success  rale  of  89.1  percent 
on  "1"  level  TS  problems  using  FPJPAs.  This  success  rate  is  most  impressive  when  compared  to  Air  Force 
control  subject  data. 

1.  This  89.1  percent  success  rate  was  10  3 percent  higher  than  the  78.2  percent  success  rate  obtained 
by  TMM  control  subjects  of  AFHRL  Advanced  Development  Study  with  more  than  6 months  experience. 

2.  it  was  28.5  percent  higher  than  die  60.6  percent  success  rate  obtained  by  TMM  control  subjects 
of  the  same  AFHRL  study  with  6 months  or  less  experience. 

3.  It  was  4.9  percent  higher  than  the  84.2  percent  success  rate  obtained  by  TMM  control  subject  of 
the  earlier  AFHRL  Twelve  Hour  Study. 

When  comparing  eidter  the  Air  Force  or  Navy  success  rates  for  inexperienced  or  experienced  subjects 
using  FPJPAs  with  those  rates  obtained  by  experienced  subjects  using  TMMs.it  should  be  emphasized  that 
these  experienced  control  subjects  used  TMMs  to  remove  and  replace  components  until  the  fault  was 
corrected.  When  using  FPJPAs.  subjects  wore  not  permitted  to  use  this  “shot  gun"  method  of  fault 
isolation.  This  current  practice  of  replacing  components  until  faults  are  corrected,  results  in  high  spare  parts 
usage  at  the  “I"  level  of  maintenance  and  excess  LRUs  handling  and  paper  work  at  the  “0"  level.  Tit  is 
practice,  also,  results  in  a large  amount  of  secondary  damage  to  hardware  which  must  he  corrected  later. 

In  addition,  this  89.1  percent  success  rate  on  "l"  level  TS  problem  obtained  by  the  medium  aptitude 
Navy  subjects  using  FPJPAs  compares  favorably  with  the  success  rates  obtained  by  the  experimental 
subjects  of  the  AFHRL  studies. 

1.  It  was  slightly  higher  than  88.8  percent  TS  success  rate  obtained  by  conventionally  trained,  iugli 
aptitude  inexperienced  subjects  using  FPJPAs  in  the  AFHRL  Advanced  Development  Study  . 
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2.  It  was  only  6.3  percent  lower  than  the  95.4  percent  TS  success  rate  obtained  by  both  categories 
of  high  aptitude  experienced  subjects  using  F RIP  As  in  the  same  AFHRL  study  - those  with  more  than  6 
months  experience  and  those  with  6 months  or  less  experience. 

3.  It  was  7.1  percent  higher  than  the  82.0  percent  TS  success  rate  obtained  by  the  medium  aptitude, 
inexperienced  high  school  subjects  using  FPJPAs  in  the  same  Twelve  Hour  Study. 

4.  It  was  only  3.9  percent  lower  than  the  93.0  percent  TS  success  rate  obtained  by  the  high 
aptitude,  inexperienced  high  school  subjects  using  FPJPAs  in  the  AFHRL  Twelve  Hour  Study 

It  can  be  concluded  that  the  Navy  medium  aptitude  “I"  level  subjects  with  only  16  weeks  of  JOT 
performed  TS  tasks  exceedingly  well  with  FPJPAs  when  compared  to  Air  Force  high  aptitude  control 
subjects  with  more  than  6 months  experience  who  used  TMMs.  These  Air  Force  control  subjects  had 
received  36  weeks  of  formal  theory  based  training  prior  to  job  assignment.  It  can  be  assumed  that  those 
Navy  medium  aptitude  “I”  level  subjects  would  have  shown  a similar  degree  of  superiority  if  compared  to 
experienced  Navy  AN/AQA-7  "I”  level  technicians. 

It  can  also  be  assumed  that  these  Navy  medium  aptitude  “I"  level  subjects  performed  as  well  with 
FPJPAs  as  did  the  Air  Force  high  aptitude  inexperienced  subjects  using  FPJPAs.  These  Air  Force  subjects 
had  received  36  weeks  of  formal  theory  based  training. 

Organizational  (0)  Level  Results 

Table  3 indicates  that  the  medium  aptitude  (40  to  50  percentile)  Navy  subjects  with  13  weeks  of  less 
than  ideal  JOT  obtained  a success  rate  of  86.6  percent  on  “O”  level  TS  problems  using  FPJPAs.  If  problem 
4A2  which  required  the  use  of  the  dual  beam  feature  of  the  oscilloscope  is  excluded,  this  success  rate 
increases  to  93.9  percent.  This  93.9  percent  figure  is  probably  more  representative  concerning  the  power  of 
FPJPAs  since  this  oscilloscope  training  deficiency  could  be  easily  corrected.  When  compared  to  control 
subject  data,  these  success  rates  were  somewhat  lower . 

1 . The  86.6  percent  success  rate  was  13.4  percent  less  than  the  100  percent  success  rate  obtained  by 
botit  the  TMN1  control  groups  of  the  AFHRL  Advanced  Development  Study,  i.c.,  those  control  subjects 
with  more  than  6 months  experience  and  those  with  6 months  or  less  experience.  (These  control  subjects 
were  permitted  to  remove  and  replace  LRUs  until  a fault  was  isolated.) 

2.  The  more  representative  93.9  percent  success  rate  was  only  6.1  percent  less  than  the  100  percent 
success  rate  obtained  by  both  experienced  control  groups.  It  is  a reasonable  assumption  that  the  93.9 
percent  success  rate  would  improve  with  experience. 


These  success  rates  of  the  NADC  experimental  subjects  (using  FPJPAs)  compare  favorably  with  the 
success  rates  obtained  by  the  experimental  subjects  of  the  AFHRL  Advanced  Developmental  Studv  (using 
FPJPAs). 

1.  The  86.6  percent  success  rate  was  only  2.3  percent  below  the  88.9  percent  success  rate  achieved 
by  the  high  aptitude  inexperienced  experimental  subjects  of  the  AFHRL  study:  The  93.9  percent  success 
rate  was  5.0  percent  above  the  success  rate  of  the  AFHRL  inexperienced  subjects. 
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2.  Although  the  86.6  percent  success  rate  was  13.4  percent  below  the  100  percent  success  rate  of 
the  high  aptitude  AFHRL  experimental  subjects  with  6 months  or  less  experience,  the  93.9  percent  rate  is 
only  6.1  percent  less  than  tire  100  percent  rate. 

3.  Tire  86.6  percent  success  rate  was  9.2  percent  below  the  95.8  percent  success  rate  of  the  high 
aptitude  AFHRL  experimental  subjects  with  more  than  6 months  experience,  but  the  93.9  percent  rate  was 
only  1.9  percent  below  these  highly  experienced  AFHRL  subjects. 

It  can  be  concluded  that  the  Navy  medium  aptitude  “0”  level  subjects  with  only  13  weeks  of  JOT 
performed  TS  tasks  reasonably  well  with  FPJPAs  when  compared  to  Air  Force  high  aptitude  control 
subjects  with  more  than  6 months  experience  who  used  TMMs  and  were  permitted  to  remove  and  replace 
LRUs  until  a fault  was  corrected.  These  Air  Force  control  subjects  had  received  36  weeks  of  formal  theory 
based  training  prior  to  job  assignment  and  are  considered  to  be  representative  of  experienced  Navy 
AN/AQA-7,  “0”  level  technicians. 
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So  Irom  these  comparisons.  it  can  he  assumed  that  Navy  answers  to  the  TS  aspects  ol  the  Itrst  three 
of  the  four  key  questions  posed  near  the  end  of  the  preceding  section  would  be  comparable  to  the  Air 
Force  answers.  As  to  question  (4)  however,  no  studies  have  been  conducted  which  have  produced  hard 
data  concerning  die  TS  sccess  with  l-TJPAs  of  either  experienced  or  inexperienced  high  aptitude  personnel 
who  had  received,  in  lieu  of  current  conventional  long  theory  based  training,  JOT  similar  to  that  used  in 
this  evaluative  tryout. 


VII.  EVALUATIVE  STATEMENT  CONCERNING  THE  AN/AQA-7  FPJI'As 

The  results  of  this  evaluative  try  out  together  with  the  comparisons  with  results  of  other  applicable 
studies  have  indicated  diat  die  FPJI’As  used  for  this  tryout  were  reasonably  effective  with  medium  aptitude 
subjects  for  “O”  level  TS  problems  and  very  effective  for  “I”  level  TS  problems.  Also,  the  fact  that  they 
worked  so  well  in  spite  of  the  "watered  down”  implementations  of  the  accompanying  JOT  programs  speaks 
well  for  their  effectiveness.  But  their  effectiveness  would  have  been  even  greater  if  all  aspects  of  the  FPJPA 
technology,  as  outlined  in  Figure  1,  had  been  included  in  their  development. 

The  tedinology  as  well  as  the  specification  and  guidance  found  in  AFHRL-TR-71-53  (Folley  et  ah. 
1971a.  ll>71b:  Joyce  et  ah.  1971)  require  that  all  the  formal  products  of  TI&A  be  reviewed  and  accepted 
by  the  procuring  agency,  in  this  case  S'ADC.  They,  also,  require  that  the  procuring  agency  ensure  that  these 
products  are  utilized  as  content  criteria  during  the  development  of  the  actual  FPJPAs.  Since  it  was  the 
prime  output  for  the  first  contract  the  task  identification  document,  the  TIM,  received  a very  thorough 
evaluation  and  official  acceptance.  With  the  exception  of  the  TIM  and  TS  action  trees,  none  of  the  other 
task  identification  and  analyses  (TI&A)  products  were  subjected  to  these  evaluation  and  acceptance 
requirements.  The  NADC  had  no  inhouse  capability  for  accomplishing  these  requirements  or  for  ensuring 
that  these  TI&A  products  were  applied  as  content  criteria  during  the  actual  FPJPA  development. 

As  a result  of  experience  gained  in  this  project  it  can  be  asserted  that  these  assessment  activities  are 
necessary  for  quality  FPJPAs  even  if  the  contractor  lias  highly  experienced  personnel  in  FPJPA 
development.  The  FPJPAs  would  probably  have  been  improved  by  such  assessment  activities  even  in  this 
case  where  the  contractor  developing  the  aids  had  previously  developed  the  AFHRL-TR-”  1 -S3  specification 
and  guidance  documents.  Such  assessment  activities  would,  also,  have  given  N'ADC  advanced  warning  of  any 
slippage  in  delivery'  schedules.  These  assessment  activities  during  development  become  absolute 
requirements  where  the  contractor  has  had  no  previous  experience  with  the  technology  . 

As  stated  in  Figure  1 , “hands  on"  validation  and  verification  of  the  final  FPJPAs  arc  also  necessary 
aspects  of  the  FPJPA  technology  and  are  required  for  ensuring  the  production  of  quality  FPJPAs.  Although 
the  Magnavox  representatives  were  required  to  attest  to  the  technical  accuracy  of  each  FPJPA,  indepth 
“hands  on”  verification  procedures  were  applied  only  to  the  FPJPAs  for  those  tasks  used  in  the  evaluative 
tryout.  A number  of  weaknessess  of  omission  and  commission  were  identified.  This  limited  verification 
reiterated  the  requirement  for  the  review  and  acceptance  of  all  products  ot  TI&A  (not  just  the  TIM  and  TS 
trees)  by  the  procuring  agency.  If  these  AN/AQA-7  FPJPA  were  to  be  given  full  scale  field  implementation, 
each  aid  would  require  a complete  “hands  on"  verification. 

As  indicated  in  Figure  I.  effective  FPJPAs  must  reflect  the  maintenance  concept  for  the  level  of 
maintenance  for  wliich  they  are  developed.  This  tryout  emphasized  the  importance  of  maintenance  concept 
stability.  During  the  development  of  the  FPJPAs  for  the  AN/AQA-7  systems,  its  “1"  level  maintenance 
concept  changed.  Originally  "I"  level  maintenance  was  responsible  for  only  identifying  faulty  integrated 
circuit  cards,  all  within  card  repair  being  assigned  to  depot  maintenance.  Part  of  this  within  card 
responsibility  was  transferred  to  the  “I"  level,  approximately  tripling  the  number  of  “I"  level  trouble 
signatures  for  FPJPA,  TS  coverage.  Because  of  time  and  R&D  funding  limitations,  FPJPAs  for  these 
additional  signatures  were  not  developed  for  this  project. 

This  is  an  example  of  the  domino  effect  on  maintenance  guidance  and/or  training  which  can  be 
produced  by  a change  in  the  maintenance  concept  of  a system.  When  FPJPAs  and  JOT  are  involved,  the 
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results  are  immediately  apparent,  because  of  the  stringent  content  controls  required  for  these  technologies. 
The  effects  of  such  drastic  changes  arc  not  always  immediately  apparent  with  traditional  theory  based 
training  and  TMMs  but  the  results  are  sometimes  hidden  in  increased  destruction  of  parts  and  secondary 
damage  to  hardware.  In  this  case,  however,  added  training  and  Navy  inhouse  repair  facilities  were  required 
including  expensive  semi-automatic  card  test  equipment.  Drastic  changes  in  maintenance  concepts  have 
such  serious  consequences,  that  any  person  or  agency  proposing  such  changes  should  be  required  to  justify 
funding  of  the  additional  training  and  maintenance  directions  required  to  implement  tiie  changes.  In  the 
cose  of  AN/AQA-7  FPJPAs,  the  necessary  modification  of  the  “I"  level  FPJPAs  for  actual  field  use  would 
have  required  a substantial  additional  expenditure  of  funds. 


VIII.  SUMMARY  AND  CONCLUSIONS 

1.  Starting  in  1972,  the  Human  Engineering  Division  of  the  Naval  Air  Development  Center  (NADC), 
Warministcr,  Pennsylvania,  supported  a FPJPA/TOT  tradeoff  effort.  Historically,  this  effort  had  its  genesis 
m the  AFHRL  FPJPA/TOT  tradeoff  demonstration  which  was  conducted  at  Altus  AFB  in  early  1972  (see 
Mullen  & Joyce.  1974).  Whereas  the  Altus  effort  was  only  a demonstration,  this  effort  was  planned  as  a full 
scale  controlled  study  to  determine  the  relative  effectiveness  of  the  combined  FPJPA  and  TOT  technologies 
with  respect  to  traditional  theory  based  training  and  TMMs.  Unfortunately,  the  controlled  comparative 
aspects  of  this  plan  were  never  completed.  Nevertheless,  FPJPA  for  "O'-  and  “I"  level  maintenance  of  the 
AN/AQA-7  Sonar  as  well  as  matching  JOT  packages  (one  for  “0"  level  technicians  and  one  for  “I"  level 
technicians)  were  developed  and  hard  data  as  to  their  effectiveness  were  obtained. 

2.  Die  job  aids  for  the  AN/AOA-7  Sonar  Recorder  Group  developed  for  this  effort  reflected  the 
vintage  of  FPJPA  technology  found  in  the  three  volume  technical  report.  AF1IRL-TR-71-53  (Policy  c!  al.. 
1971a.  1971b;  Joyce  et  al..  1971).  This  was  a substantially  more  advanced  vintage  of  developmental 
technology  than  that  reflected  by  the  FPJPAs  used  in  the  Altus  AFB  demonstration,  which  were  developed 
without  the  benefit  of  such  structured  guidance.  The  aids  used  at  Altus  AFB  were  limited  toTS.  whereas 
the  aids  developed  for  this  cffuit  covered  non-TS  tasks  as  well. 

3.  Although  the  results  of  this  tryout  indicated  that  the  AN/AQA-7  aids  were  effective  and  of 
adequate  quality,  their  development  effort  omitted  some  very  important  aspects  of  the  specification  and 
guidance  found  ir.  AFHRL-TR-71-53.  These  documents  require  that  all  the  formal  products  of  the  TI&A  of 
identified  tasks  be  reviewed  and  accepted  by  the  procuring  agency,  in  this  case  NADC.  They,  also,  require 
that  the  procuring  agency  ensure  dial  these  products  are  utilized  as  content  criteria  during  the  development 
of  the  actual  FPJPAs.  The  only  TI&A  products  which  received  such  treatment  were  the  troubleshooting 
action  trees.  (For  this  specific  procurement,  these  development  omissions  did  not  result  in  unsatisfactory 
aids.  The  contractor  developing  the  aids  had.  also,  developed  the  AFHRL-TR-71-53  specification  and 
guidance  documents.)  In  addition,  due  to  funding  and  scheduling  problems,  all  FPJPAs  did  not  receive  the 
required  contractor  validation  and  the  government  verification.  Onlv  those  FPJPAs  used  for  the 
experimental  tryout  problems  received  such  treatment. 

4.  As  to  the  JOT  packages,  they  were  substantially  more  complete  than  those  developed  for  the 
Altus  demonstration.  For  those  subjects  assigned  to  “O"  level  maintenance  a 13-week  JOT  package  was 
developed  to  prepare  medium  aptitude  personnel  (approximately  40  to  50  percentile)  to  perform  “0"  level 
maintenance  on  the  AN/AQA-7  Sonar  Recorder  Group  of  the  S2-G  aircraft  using  FPJPAs.  A 16-week  JOT 
package  was  developed  to  prepare  the  same  range  of  medium  aptitude  personnel  to  perform  'T‘  level 
maintenance  tasks  on  the  same  equipment  using  FPJPAs.  These  JOT  packages  were  of  good  quality. 
However,  since  these  packages  arrived  4 weeks  after  training  started,  the  subjects  did  not  obtain  the  full 
advantage  of  their  potential. 

5.  Traditionally,  the  .AN  A QA-7  System  has  been  maintained  by  “A”  school  graduates  using  TMMs. 
The  entry  aptitude  for  “A  " school  is  S4  percentile  and  above.  The  appropriate  “A"  school  program  was  22 
weeks  in  length  and  was  theory  based.  Students  selected  for  “0"  level  maintenance  received  two  additional 
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weeks  of  AN/AQA-7  specific  training,  making  the  conventional  training  a total  of  24  weeks.  Students 
selected  for  “I”  level  maintenance  received  1 4 additional  weeks  of  system  specific  training,  making  the 
conventional  training  a total  of  36  weeks.  So  the  JOT  package  for  "0”  level  training  was  1 1 weeks  shorter 
than  conventional  training  (a  46  percent  savings  in  training  time)  and  the  “I"  level  package  was  20  weeks 
shorter  than  conventional  training  (a  56  percent  savings  in  training  timel. 

6.  The  original  plan  for  the  conduct  of  JOT  included  the  following  assumptions:  (a)  students 
would  arrive  in  tour  groups  of  10  each  approximately  1 to  2 weeks  apart,  (b)  there  would  be  four 
instructors,  two  to  teach  the  ‘"1"  level  maintenance  program  and  two  to  teach  the  “O"  level  maintenance 
program,  (c)  two  AN/AQA-7  systems  and  two  AN/AQM-I8  test  benches  could  be  made  available  for  the 
exclusive  use  of  the  project,  and  (d)  access  to  S2G  aircraft  (with  operating  AQA-7s)  could  be  obtained. 
Unfortunately,  none  of  these  conditions  were  met,  the  students  anived  early  and  all  within  a single  10-dav 
period,  only  three  instructors  could  be  recruited,  only  one  AN/AQA-7  and  AN/AQM-1S  could  be  provided, 
and  access  to  S2G  aircraft  was  limited  due  to  heavy  flight  commitments  of  the  operational  forces.  Finally, 
as  mentioned  previously,  the  JOT  training  materials  were  delivered  approximately  one  month  late  and  not 
properly  collated.  After  delivery  and  assembly  of  the  training  materials,  the  41  trainees  were  divided  into 
three  sections',  two  sections  of  13  trainees  each  were  assigned  to  “1"  level  training  and  one  section  of  15 
trainees  was  assigned  to  "O’'  level  training.  Three  "O”  level  and  three  “I"  level  subjects  were  dismissed  from 
the  program  for  non-academic  teasons. 

7.  For  this  evaluative  tryout,  a concerted  effort  was  made  to  provide  a realistic  and  practicable 
work  setting  with  representative  maintenance  problems.  Since  the  data  collection  had  to  be  accomplished  in 
4 weeks,  only  live  problems  could  lie  scheduled  for  each  "O"  level  subject  and  only  four  for  each  "I"  level 
subject.  However,  the  problems  selected  are  considered  representative.  The  results  of  performance  of 
subjects  concerning  the  "0"  and  "1"  level  maintenance  problems  are  displayed  in  Tables  1 and  2. 
respectively.  Their  composite  success  on  ”0"  level  problems  was  86.6  percent  and  on  "T"  level  problems 
was  82.5.  .Ml  the  "O”  level  problems  concerned  TS.  On  their  two  TS  problems,  the  “I"  level  subjects 
obtained  an  S9.1  percent  rate. 

8.  These  results  reinforce  the  results  of  other  DoD  Job  Performance  Aid  R&D.  They  also  provide 
important  additional  data.  The  results  are  comparable  to  and  complement  those  reported  for  the  AFHRL 
Advanced  Development  Study  (Potter  &.  Thomas.  1976).  In  this  AFHRL  study,  which  considered  only  TS 
problems,  the  inexperienced  subjects  isolated  approximately  89  percent  of  both  “0"  and  “I”  level  troubles 
(sec  Tables  3 and  4).  It  should  be  noted  that  this  AFHRL  study  utilized  high  aptitude  subjects  (80 
percentile  and  above),  who  had  completed  36  weeks  of  conventional  theory  based  training,  whereas  this 
evaluative  tryout  utilized  only  medium  aptitude  subjects  (40  to  50  percentile)  who  had  completed  either  13 
or  16  weeks  of  JOT. 

9.  The  “1”  level  TS  success  rate  of  approximately  89  percent  obtained  both  by  these 
inexperienced , medium  aptitude.  Navy  subjects  and  by  the  inexperienced , high  aptitude  Air  Force  subjects 
is  very  impressive  when  compared  to  available  control  data.  The  control  subjects  with  more  than  6 months 
experience  of  the  AFHRL  Advanced  Development  solved  78.8  percent  of  their  “1"  level  TS  problems  when 
using  TMMs  and  the  control  subjects  with  6 months  or  less  experience  solved  only  60.6  percent.  These 
AFHRL  control  subjects  were  high  aptitude  subjects  who  had  received  at  least  36  weeks  of  conventions 
theory  based  training. 

10.  Although  less  dramatic,  the  "O"  level  TS  results  obtained  by  these  inexperienced  Navy  and  Air 
Force  subjects  arc  quite  good  when  compared  to  the  available  control  data.  These  Navy  medium  aptitude 
subjects  using  FPJPA,  obtained  a composite  success  rate  of  86.6  percent  (see  Table  3).  If  the  problem 
requiring  the  use  of  the  dual  beam  feature  of  the  oscilloscope  is  excluded,  this  rate  is  93.9  percent.  The  Air 
Force  inexperienced  subjects  using  FPJPAs  obtained  a composite  rate  of  88.9  percent.  .Although  the 
experienced  Air  Force  control  subjects  obtained  100  percent  success  rates  when  using  TMMs.  they  were 
permitted  to  remove  and  replace  components  until  the  troubles  were  found,  whereas  inexperienced 
experimental  subjects  using  FPJPAs  were  not. 
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1 1.  The  subjects  of  this  Navy  study  as  well  as  those  in  the  AFHRL  Advanced  Development  Study 
(Potter  & Thomas.  1976)  and  the  Aitus  AFB  demonstration  (Mullen  & Joyce,  1974)  displayed  weaknesses 
in  their  ability  to  use  key  test  equipments,  especially  the  oscilloscope.  The  percentages  of  troubles 
successfully  found,  although  impressive,  would  no  doubt  have  been  higher  if  subjects  had  possessed  high 
proficiency  in  the  use  of  their  test  equipment.  (There  is  also  substantial  evidence  that  the  inability  to 
adequately  use  oscilloscopes  is  a common  weakness  of  many  DoD  experienced  maintenance  technicians 
(Foley.  1975).) 

12.  This  project  demonstrated  the  feasibility  of  combining  the  FPJPA  and  JOT  technologies  and 
that  such  a combination  would  reduce  initial  training  time  for  first  term  maintenance  personnel.  In  spite  of 
all  the  difficulties  previously  mentioned,  the  performance  of  the  medium  aptitude  subjects  of  this  Navy 
evaluative  tryout  was  impressive  when  compared  to  available  control  data.  Their  performances  using 
FPJPAs  were  as  good  or  better  than  the  performances  of  high  aptitude,  conventionally  trained  subjects 
using  TMMs  in  other  studies.  All  of  the  mentioned  difficulties  arc  correctable  and  their  correction  would 
result  in  still  higher  levels  of  performance. 

13.  So,  the  combined  implementation  of  the  FPJPA  and  JOT  technologies  would  result  in  three 
major  benefits  to  the  Navy.  It  would  greatly  reduce  the  training  time  required  for  first  enlistment 
maintenance  personnel;  thus,  increasing  their  on-the-job  time.  It  would,  also,  permit  the  training  of  medium 
aptitude  personnel,  in  addition,  to  the  currently  utilized,  high  aptitude  personnel  now  required  for  the  long 
traditional  theory  based  training.  And  while  providing  these  impressive  personnel  benefits,  it  would  increase 
the  efficiency  of  the  performance  of  maintenance  including  a substantial  reduction  in  spare  parts  usage.  The 
realization  of  these  benefits  however  requires  the  quality  implementation  of  these  technologies  under  the 
direction  of  personnel  with  successful  experience  in  their  applications.  To  do  otherwise,  will  invite 
"watered  down"  implementation  followed  by  "watered  down."  if  not  disastrous,  field  results. 

Lessons  Learned 

1.  This  evaluative  tryout  reiterates  findings  of  other  FPJPA  studies  that  the  effectiveness  of  quality 
FPJPAs  can  be  substantially  degraded  by  users'  inability  to  use  their  test  equipments  proficiently.  In  all 
future  applications  of  FPJPAs.  appropriate  actions  must  be  taken  to  assure  that  FPJPA  users  can  employ 
their  test  equipment  accurately. 

2.  Although  in-depth  “hands  oil"  verification  procedures  were  only  applied  to  FPJPAs  for  those 
tasks  used  in  the  evaluation,  a number  of  weaknesses  of  omission  and  commission  were  identified.  This 
partial  verification  reiterated  the  requirement  for  the  review  and  acceptance  of  all  products  of  TI&A  (not 
just  TS  trees)  by  the  procuring  agency.  The  procuring  agency  must  also  ensure  that  the  appropriate  Tl&A 
products  arc  used  as  criteria  for  content  control  during  FPJPA  development.  And  these  assessment  activities 
arc  necessary  for  quality  FPJPAs  even  if  'die  contractor  has  higlily  experienced  personnel  in  FPJPA 
development.  (These  necessary  activities  require  that  the  procuring  activity  have  personnel  with  the 
necessary  skills.)  As  stated  in  Figure  1,  these  activities,  together  with  validation  and  verification  of  the  final 
FPJPAs,  are  all  part  of  the  FPJPA  technology  and  are  necessary  activities  for  ensuring  the  production  of 
quality  FPJPAs. 

3.  During  the  development  of  the  FPJPAs  for  the  AN/AQA-7  systems,  its  "I"  level  maintenance 
concept  changed.  Originally  “1"  level  maintenance  was  responsible  for  only  identifying  faulty  integrated 
circuit  cards,  all  within-card  repair  being  assigned  to  depot  maintenance.  Part  of  this  within-card  repair 
responsibility  was  transferred  to  the  “1"  level,  approximately  tripling  the  number  of  “1”  level  trouble 
signatures  for  FPJPA,  TS  coverage.  Because  of  time  and  R&D  funding  limitations.  FPJPAs  for  these 
additional  signatures  were  not  developed  for  this  project.  This  is  an  example  of  the  domino  effect  on 
maintenance  guidance. and/or  training  which  can  be  produced  by  a change  in  the  maintenance  concept  of  a 
system.  When  FPJPAs  and  JOT  are  involved,  the  results  are  immediately  apparent,  because  of  the  stringent 
content  controls  required  for  these  technologies.  Although  the  effects  of  such  a drastic  change  in 
maintenance  concept  ate  not  as  immediately  apparent  with  traditional  theory  based  training  and  TMMs,  the 
results  no  doubt  arc  hidden  in  increased  destruction  of  parts  and  costly  secondary  damage  to  hardware-in 
this  case,  to  expensive  integrated  circuit  cards. 
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Suggestions  for  Future  Applications 

Program  managers  and  system  acquisition  personnel  charged  with  procurement  of  technical  manuals 
and  training  systems  can  no  longer  ignore  the  enormous  benefits  possible  through  the  application  of  the 
JPA/JOT  technologies.  Even  experienced,  traditionally  trained  personnel  are  more  content  and  effective 
with  clearly  and  simply  written  maintenance  instructions. 

In  order  to  gain  maximum  benefit  from  the  JPA/JOT  technology,  a large  portion  of  maintenance 
instructions  must  be  developed  using  JPA  technology  . When  a sufficient  body  of  technical  data  for  a 
specific  weapon  system  or  a selected  rate  (job  code!  has  been  developed  it  will  be  possible  to  start  changing 
over  from  long,  theory -oriented  basic  schools  such  as  the  Navy  "A"  schools  to  direct  inputs  to  job-oriented 
training  such  as  now  exist  at  Navy  readiness  squadrons  under  the  Fleet  Readiness  Aviation  Maintenance 
Program  (FRAMPJ  and  to  a certain  extent  at  the  Naval  Aviation  Maintenance  Training  Detachments 
(NAMTRADETS).  These  training  elements  now  provide  weapon  system  specific  training  which  however 
assumes  a theoretical  base  established  at  the  Navy  “A"  schools. 

Therefore,  it  is  recommended  that  the  JPA/JOT  technology  be  applied  to  all  training  and  technical 
data  bought  to  support  new  acquisitions,  or  major  modification  to  existing  equipment  The  JOT  can  be 
incorporated  into  the  NAMTRADET  and  FRAMP  curricula  and  when  a sufficient  body  of  technical  data 
has  been  transtormed  into  JPA  format  maintainees  can  be  ordered  directly  from  recruit  training  to  weapon 
system  specific  JOT. 
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Introduction 


This  appendix  describes  the  process  by  which  the  integrated  develop- 
ment of  JPA*  and  training  was  accomplished.  The  process  description  is 
heavily  supported  with  examples  of  actual  experimental  materials  from  the 
AN-AQA-7  JPA  and  Course,  and  with  intermediate  products  used  in  their 
development.  Complete  files  of  intermediate  and  final  products  reside  at 
the  office  of  CDR  Charles  J.  Theisen,  Jr., 1 Head,  Training  Branch  (4024), 
Naval  Air  Development  Center,  Warminster,  Pennsylvania  18974.  Because 
the  process  of  JPA  development  is  controlled  by  specification  and  has 
been  described  in  great  detail  elsewhere,  the  focus  of  this  appendix  is  on 
process  features  employed  for  the  first  time  here,  and  on  unique  aspects 
of  this  effort.  In  general,  the  Drocess  followed  is  outlined  in  detail 
in  AFHRL-TR-71-53  (Folley  et  al,  1971a;  1971b;  & Joyce  et  al,  1971). 

Figure  A-l  schematizes  the  relations  among  major  development  efforts. 


Figure  A-l.  The  Development  of  JPA  and  Training  Mater  1 '.Is 


*Job  Performance  Aids. 

^Now  Commanding  Officer,  Naval  Hospital  Corps  School,  Great  Lakes,  IL. 
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First,  maintenance  tasks  to  be  performed  were  identified  and  analyzed. 
This  analysis  resulted  in  task  analysis  intermediate  products,  documents 
descriptive  of  the  audience,  his  tasks,  tools,  equipment,  etc.,  and  in 
lists  of  nouns  and  verbs  to  be  used  in  the  program,  and  a writing  style 
guide.  Behavioral  Scientists  decided  which  tasks  were  best  covered  in 
training  and  which  by  the  JPA.  This  analysis  resulted  in  a data  cover- 
age plan  and  a set  of  training  requirements.  Finally,  the  training  and 
JPA  were  prepared  and  validated. 


Task  Identification  Matrix 

The  Task  Identification  Matrix  (TIM)  is  as  described  in  AFHRL-TR-71-53 
except  that  the  maintenance  function  codes  have  been  modified  as  follows: 

X codes  indicate  maintenance-significant  components. 

A hardware  item  with  an  X code  must  be  considered 
a maintenance-significant  part  of  the  next  super- 
ordinate  T entry  in  the  same  column.  In  the  case 
of  a troubleshooting  T,  each  subordinate  X must 
be  found  by  the  troubleshooting  as  a cause  of 
malfunction.  Each  subordinate,  X-coded,  piece- 
part  shall  be  considered  a "Component"  in  the 
List  of  Components  (AFHRL-TR-71-53,  para  3.4.5a). 

All  subordinate  X-coded  components  join  to  form 
a definitive  list  of  the  end  items  associated 
with  a particular  troubleshoot  task. 


Subscript  codes  indicate  ievel  of  maintenance  or  maintenance 
activity. 


0 = Organizational  Maintenance 

1 = First  level  Intermediate  maintenance; 

refer  to  Figure  A-2  (AQA-7  Data  Coverage 
Plan) . All  checkout  and  troubleshoot 
tasks  directly  subordinate  to  Organiza- 
tional maintenance  are  coded  with  the 
subscript  I;  thus,  their  subordinate 
components  are  coded  X_ . 


I 


Second  level  Intermediate  maintenance 
procedures  to  which  the  user  would  be 
referred  from  the  first  level  pro- 
cedures . 


AQA  7 DATA  COVERAGE  PLAN 
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Special  Notes: 

1.  A section  in  the  Maintenance  Support  Informa- 
tion Manual  (MSIM)  will  be  included  to  cover 
relamping  all  of  the  back-lighted  pushbutton 
switches  and  similarly  styled  indicators. 

The  components  of  these  assemblies  are 
indicated  in  the  TIM  by  the  symbol  (T)  . 
Although  there  are  many  of  these  assemblies 
referenced,  they  are  so  similar  that  one 
MSIM  section  will  cover  all  of  them. 

2.  A section  will  also  be  included  in  the 
MSIM  to  cover  removal  and  replacement 
of  all  digital  readouts.  These  com- 
ponents  are  indicated  by  the  symbol  (T) 
in  the  TIM. 

3.  A section  will  also  be  included  in  the 
MSIM  to  cover  all  60-hour  cleaning  tasks . 

4.  Components  in  italics  are  included  to 
preserve  generation  breakdown. 


Two  example  TIM  pages  follow  (Figure  A-3) . 


Task  Analysis  Intermediate 
Products 


lask  analysis  intermediate  products  include  the  Task-Step  Data 
Details  (TSDD) , the  Generic  Noun  List,  the  Test  Equipment  and  Tool  Use 
Forms  (TETUF) , the  Task  Inventory,  and  a Style  Guide.  These  documents 
provide  additional  clarification,  guidance,  and  control  for  task  analy- 
sis considerations  and  JPA  writing.  Examples  of  these  documents  follow 
(Figures  A-4  through  A-8) . 
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AN/AQA-7  FPJPA  TASK-STEP  DATA  DETAILS  (TSDD) 


1.  DISCRIMINATIONS  AND  PERCEPTIONS  CRITICAL  TO  SUCCESSFUL  TASK  PERFORMANCE 

a.  Observing  Gross  Indications.  The  task  step  should  name  the  indicator 
and  will  state  the  condition  to  be  observed  (for  example,  a light  on  or  off; 
a motor  running  or  not  running) . The  illustration  will  depict  the  indica- 
tor's location;  wherever  practical  and  necessary  to  communicate  an  instruc- 
tion, the  illustration  will  also  show  the  state  of  the  indicator. 

Training  will  provide  knowledge  of  the  physical  context  of  indica- 
tors . 

b.  Reading  Quantitative  Values.  The  task  step  will  state  a range  of 
acceptable  values  by  naming  the  inclusive  limits  of  the  range.  The  loca- 
tion of  the  indicator  (scale,  counter)  will  be  illustrated  (with  the 
exception  of  some  common  pieces  of  test  equipment — see  the  Test  Equipment 
and  Tool  Use  Form).  Counter  readings  will  not  be  illustrated.  Necessary 
scale  reading  and  interpolation  skills  are  assumed  to  be  present  in  the 
user.  These  skills  will  be  developed  in  a specific  segment  of  the  train- 
ing program. 

c.  Noting  Relative  Motion.  When  relative  motion  is  an  important  cue, 
the  task  step  will  describe  the  relevant  dimensions  of  motion  (direction 
and/or  rate)  of  objects  with  respect  to  one  another,  and  will  include  a 
statement  of  the  observer's  position  relative  to  the  objects  whenever  his 
position  is  necessary  for  correct  interpretation  of  the  text  (e.g.,  a fan 
rotating  clockwise  when  viewed  from  the  front) . Illustration  of  the  moving 
components  will  indicate  the  direction  of  motion  with  the  use  of  an  arrow 
pointing  from  each  object  along  its  path  of  motion. 

Training  will  provide  practice  using  task  steps  utilizing  motion 
symbology . 

d.  Reading  or  Interpreting  Oscilloscope  Patterns  or  Waveforms.  The 
task  step  text  will  require  the  technician  to  compare  his  display  with  a 
standard  provided  in  the  illustration.  The  illustration  will  be  a white- 
on-black  rendering  of  the  nominal  expected  display,  with  the  frequency, 
amplitude,  and/or  shape  tolerance  range  indicated  with  dimension  lines, 
and  a statement  of  the  tolerance  (e.g.,  "greater  than  10  divisions"). 

Training  will  provide  exposure  to  typical  waveform  and  tolerance 
displays.  Practice  sessions  using  the  oscilloscope  will  also  utilize 
FPJPA  waveform  presentation  techniques  to  provide  practice  reading  and 
interpreting  waveforms. 


Figure  A-4.  Task-Step  Data 
Details  (TSDD) 
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e.  Noting  Visually  Detectable  Physical  Defects.  The  task  step  will 
instruct  the  technician  to  visually  inspect  an  object  and  will  name  specific 
defects  to  look  for  (e.g.,  scored  cylinder  walls,  deteriorated  "0"  ring, 
charred  insulation,  or  change  in  color  of  an  object) . 

Training  will  provide  exposure  to  samples  of  hardware  containing 
defects  of  the  type  requiring  detection  by  the  manuals.  Trainees  must 
demonstrate  the  ability  to  describe  and  detect  all  visually  detectable 
malfunctions  mentioned  in  the  FPJPAs. 

f.  Presence  or  Absence  of  Sounds  and  Vibrations.  Sounds  and  vibra- 
tions will  be  used  only  as  gross  indicators.  The  task  step  will  ask  only 
that  the  technician  note  presence  or  absence  of  a sound  or  vibration  and 
will  tell  him  where  to  direct  his  attention.  No  discriminations  of  loud- 
ness of  sound  or  of  amplitude  of  vibration  will  be  required.  The  illus- 
tration will  depict  the  location  of  the  source  of  the  sound  or  vibration. 

Training  will  provide  exposure  to  normal  operation  sounds. 

g.  Discrimination  of  Pitch  or  Other  Characteristics  of  a Sound.  Abso- 
lute pitch  judgments  will  not  be  required;  but  if  a tone  can  sweep  through 
a range  of  frequencies,  the  technician  may  be  required  to  observe  whether 
the  pitch  increases  or  decreases.  The  technician  will  be  required  to 
discriminate  only  presence  or  absence  of  other  sound  characteristics. 

h.  Discrimination  of  Odors.  No  olfactory  discriminations  will  be 
required  of  the  FPJPA  user. 


2.  PROBLEM-SOLVING  AND  DECISION-MAKING  CRITICAL  TO  SUCCESSFUL  TASK 
PERFORMANCE 

a.  Selection  of  Appropriate  Next  Step  or  Task.  The  task  steps  will 
always  follow  each  other  in  numerical  order.  References  to  other  steps 
or  tasks  will  provide  sufficient  information  to  proceed  directly  to  the 
referenced  material,  in  accordance  with  para.  3. 3. 7. 3 of  AFHRL-TR-71-53 , 
Vol . I. 


b.  Performing  Calculations.  Any  problems  requiring  mathematical 
sophistication  beyond  simple  addition  and  subtraction  will  be  reduced  to 
these  simple  operations,  or  will  be  aided  by  a nomogram  or  tabular 
presentation  of  data. 

Training  will  provide  practice  in  performing  simple  calculations 
and  using  nomograms  or  tables  specifically  used  in  the  FPJPAs. 

c.  Exercising  Judgment.  FPJPA  users  will  be  required  to  exercise 
judgment  to  recognize  a visually  detectable  malfunction,  including  those 
introduced  by  the  technician  during  repairs. 

Figure  A-4.  Task-Step  Data  Details  (TSDD) 

(cont . ) 
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d.  Translating  or  Converting  Data  Forms.  When  conversions  from  one 
data  form  to  another  are  required  (e.g.,  Fahrenheit  to  Centigrade,  octal 
to  decimal,  degrees  to  radians),  tabular  or  graphic  conversion  aids  will 
be  provided  in  the  MSIM.  When  such  tabular  or  graphic  conversion  aids 
are  provided,  they  will  be  accompanied  by  detailed  instructions  for  their 
use,  including  examples  if  necessary. 


3.  MOTOR  ACTIONS  CRITICAL  TO  TASK  PERFORMANCE 

a.  Activating  Binary  Switches.  The  task  step  will  name  the  control 
and  the  position  to  which  it  is  to  be  set.  The  illustration  will  depict 
the  location  of  the  switch,  but  the  user  must  depend  upon  the  text  for 
position  (setting)  information. 

The  training  program  will  provide  practice  experiences  for  locating 
and  operating  all  system  front  panel  controls. 

b.  Adjusting  Continuous  Controls  to  Specified  Setting.  The  task  step 
will  name  the  control  and  specify  the  direction  of  operation  (e.g.,  clock- 
wise, to  the  left) . The  step  will  also  name  the  value  to  be  set  and  the 
indicator  upon  which  the  value  is  to  be  read  (e.g.,  turn  IF  GAIN  control 
clockwise  until  M01  reads  0.5  volts).  Whenever  a peak  or  null  indication 
is  expected,  that  condition  will  be  so  stated,  with  the  assumption  that 
the  user  knows  how  to  recognize  it  (e.g.,  adjust  TUNE  control  until  null 
is  observed  on  M01) . The  illustration  will  depict  the  locations  of  con- 
trols and  displays. 

c.  Setting  a Multiposition  Control  to  a Specified  Setting.  The  c sk 
step  will  name  the  control  and  the  position  to  which  it  must  be  set.  7; e 
illustration  will  depict  the  location  of  the  control,  but  the  user  must 
depend  on  the  text  for  the  setting  information. 

d.  Performing  Coordinated  Gross  Body  Movements.  The  task  steps  - . 
describe  movements  and  body  positions  necessary  to  move  or  position  hard- 
ware items.  Appropriate  Human  Engineering  guides  will  be  consulted  to 
assure  that  all  required  moving,  lifting,  and  reading  operations  are  within 
the  user's  capabilities. 


4.  READING  LEVEL  AND  READING  COMPREHENSION  CRITICAL  TO  TASK  PERFORMANCE 

a.  Sentence  Length.  Task  statements  will  contain  no  more  than  three 
sentences.  Each  sentence  will  contain  10  words  or  less  (refer  to  AFHP.L- 
TR-71-53,  para  3.3.7.3.L). 

b.  Word  Length.  Language  of  the  task  statements  (other  than  hardware- 
specific  nomenclature  and  placarded  information)  will  be  as  simple  as  possible 
Syllable  counts  will  be  performed  on  random  page  samples  excluding  hardware- 
specific  and  placarded  terms;  150  syllables/one-hundred  words  will  be  the  goal 

Figure  A-4.  Task-Step  Data  Details  (TSDD) 

(cont . ) 
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c.  Vocabulary.  The  vocabulary  used  in  the  FPJPAs  will  come  from 
lists  of  standard  verbs,  common  (generic)  nouns,  and  hardware— specif ic 
nouns . 


Since  reading  level  is  a function  of  vocabulary  difficulty,  the 
standard  lists  will  be  combined  to  form  either  a Maintenance  Support 
Information  Manual  section  (glossary)  or  a training  handout.  In  either 
case,  training  shall  be  expected  to  devote  some  tine  directly  to  hardware- 
specific  terminology  in  addition  to  placarded  terms,  and  properly  use  the 
verbs  and  generic  nouns  as  a matter  of  course  during  training  and  in  train- 
ing materials.  Training  will  provide  familiarity  with  terminology  in  con- 
text, task  step  presentation  format,  and  symbology  utilized. 

1)  Verb  List.  The  verb  list  in  AFHRL-TR-71-53 , para  6-2, 
shall  be  considered  the  official  source  of  verbs  (331 
verbs) . This  list  may  be  modified  to  include  new  verbs 
as  a clear  and  definite  need  arises.  (Six  verbs  were 
added  for  the  AN-AQA-7  FPJPAs.) 

2)  Generic  Nouns.  The  generic  noun  list  shall  be  con- 
sidered the  official  source  and  is  modificable  as  in 
1)  above.  (The  list  for  the  AN-AQA-7  FPJPAs  included 
82  nouns.) 

3.  Hardware  Svstem-Specif ic  Nouns . The  approved  Task 
Identification  Matrix  (TIM)  shall  serve  as  the 
official  source  of  hardware-specific  nouns. 

4.  Placarded  Information.  When  control  panel  placarding 
groups  controls  functionally  as  well  as  uniquely  identi- 
fying each  control,  the  general  level  placarding  shall 
be  omitted. 

5.  Standard  Statements.  Standard  forms  will  be  used  where 
the  individual  task  steps  are  very  similar  (e.g.,  each 
use  of  a particular  piece  of  test  equipment  is  the  same 
except  for  expected  reauing,  point  of  test,  and  reference 
if  test  is  failed) . Each  occurrence  of  a similar  event 
will  be  written  the  same  except  for  the  unique  variable 
information . 


SYNONYMS  BY  ORDER 

NOUN  DEFINITION  EXAMPLE  OF  PREFERENCE 
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between  unrelated  conductors. 
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TEST  EQUIPMENT  AND  TOOL  USE  FORM 


Name  and  Number 
of  Item 

Functions 

Information  to  be 
Included  in  JPA 

Information  to  be 
Given  in  Training 

Digital  Frequency  Generates  and/ 
Synthesizer,  or  sweeps  fre- 
Model  3100A  quencies  from 


Generates  and/  1.  The  user  will  be 
or  sweeps  fre-  told  where  to  connect 
quencies  from  the  output  and  which 
0.01  Hz  to  output  is  to  be  used; 

1.3  MHz.  e.g.,  connect  -20dbm 

50  0 output  to 

( ).  The 

input  location  will  be 
I illustrated. 


2.  Switch  setting 
information  will  be 
supplied  for  the 
MODE  switch;  e.g., 
sec  MODE  switch  ( ) 

to 


3 .  When  VARIABLE 
50  n output  is  used, 
switch  setting  in- 
formation will  be 
supplied  for  the  DC 
OFFSET,  VERNIER,  and 
dbm;  e.g.,  a)  Set 

DC  OFFSET  to  . 

b)  Set  VERNIER  to 

. c)  Set 

dbm  to 


4.  When  variable 
DECADE  is  used,  set- 
ting information  will 
be  supplied  for  the 
DECADE  SELECT,  DRIVE 
SELECT,  and  ATTENUA- 
TOR: e.g. , a)  Set 
DECADE  SELECT  to 

. b)  Set 

DRIVE  SELECT  to 
. c)  Ro- 
tate ATTENTUATOR 
control  counterclock- 
wise until 


1.  Recognition  of 
equipment  by  sight 
when  specified  by 
name . 


2.  How  to  set  up 
equipment  ready  for 
tests . 


3.  Practice  making 
tests  using  the 
equipment : 


finding  and  setting 
switches 


locating  and  making 
connections 


rigure  A-6 . Example  Test  Equipment 

and  Tool  Use  Form  (TETUF) 
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AN/AQA-7  TASK  INVENTORY 

1.  Checkout  and  Troubleshoot  the  AN/AQA-7 

A.  Checkout  and  Troubleshoot  the  Bearing  Frequency  Control,  C-8245 

B.  Checkout  and  Troubleshoot  the  Directional  Listening  Control,  C-8246 

1.  Align  the  Directional  Listening  Control,  C-8246 

C.  Checkout  and  Troubleshoot  the  Bearing  Computer,  CP-983 

D.  Checkout  and  Troubleshoot  the  Bearing  Frequency  Indicator,  IP-981 

1.  Checkout  and  Troubleshoot  the  Video  Amplifier 

2.  Adjust  the  Video  Amplifier 

3.  Checkout  and  Troubleshoot  the  Deflection  Amplifier 

4.  Adjust  the  Deflection  Amplifier 

E.  Checkout  and  Troubleshoot  the  Digital  Memory  Unit 

F.  Checkout  and  Troubleshoot  the  Frequency  Multiplier-Storer 

1.  Align  the  R.F.  Oscillator 

2.  Adjust  the  Multiplier  Amplifier 

3.  Adjust  the  R.F.  Amplifier 

G.  Checkout  and  Troubleshoot  the  Spectrum  Analyzer-Quantizer 

1.  Align  the  Signal  Analyzer 

2.  Align  the  Signal  Analyzer-DIFAR 

3.  Align  the  Sweep  Generator 

Figure  A-7.  Page  from  Task  Inventory 
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AN/AQA-7  FPJPA  STYLE  GUIDE 

1.  3c  consistent  with  the  level  of  accuracy:  The  case  is  2.75  inches  bv 
6 ■ 50  inches  by  10.54  inches. 

2.  Always  precede  the  decimal  point  with  a zero  in  expressions  less  than 
unity:  0.056  volt  ac. 

3.  Panel-mounted  tip  jacks  shall  be  designated  as  test  jacks ; multipin 
jacks  and  plugs  shall  be  designated  as  either  jacks  or  plugs. 

4.  When  referring  to  a pin  on  a multipin  connector,  separate  the  con- 
nector number  from  the  pin  designation  by  a hyphen  (J5-F,  J6-4,  PS-F, 
P6-4) . 

5.  Access  doors  and  panels  are  opened  or  closed . 

6.  Covers  are  removed  or  reinstalled. 

7.  Drawers  are  opened  or  closed . 

8.  Fasteners  and  latches  are  secured  or  released . 

9.  Nuts  and  bolts  are  tightened;  when  required,  they  are  tightened  to  a 
specific  torque ■ (Tighten  nut  _to  500  pound-inches  torque . ) 

10.  Screws  are  installed  or  removed. 

11.  Components  are  removed  or  installed ; replace  a component  or  part  if  a 
new  or  repaired  one  is  to  be  installed. 

12.  Brakes  are  set  or  released . 

13.  Auxiliary  equipment  is  connected  to  test  jacks,  filler  valves,  etc. 

14.  Pressure  is  applied  to  ports,  valves,  cyclinders,  etc. 

15.  Output  or  input  is  applied  or  measured  between  test  jacks,  test  points, 
etc. 

16.  Meters  and  dials  indicate . (They  do  not  read.) 

17.  Circuit  breakers  are  opened  and  closed , and  set  or  reset . 

18.  Rotary  and  toggle  switches  are  set  to  a position.  (Set  power  switch 
_to  ON.) 

19.  Pushbutton  switches  are  depressed  and  released . Momentarily  depress 
self- test  switch.  Depress  and  hold  self-test  switch.  Release 
self-test  switch.) 

Figure  A-8.  Page  from  Style  Guide 
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JPA  Development 

I 


Introduccion 

One  unique  feature  of  development  in  the  AQA-7  JPA  effort  was  com- 
puterization of  substantial  parts  of  the  work.  This  was  done  for  reasons 
outlined  below. 

The  traditional  JPA  development/production  process  is  long  and  intri- 
cate, and  every  activity  along  the  way  is  performed  by  humans.  Some  acti- 
vities call  for  tedious  cross-checking  and  comparison,  and  making  sure  the 
right  numbers  are  entered  in  the  right  places.  The  process  takes  a lot  of 
time,  and  has  many  opportunities  for  errors  and  oversights.  It  requires 
tremendous  coordination  of  human  activities.  After  carefully  studying 
JPA  processes  and  problems,  computer  experts  decided  that  four  steps  in 
the  process  were  particularly  amenable  to  computer  assistance: 

1.  Development  of  Action  Trees.  This  is  a slow,  difficult  job, 
complicated  by  a great  deal  of  repetitive  writing  and  refer- 
encing. Performed  simultaneously  by  several  analyst/writers, 
this  effort  is  in  constant  jeopardy  of  inconsistency  and 
error . 

2.  Editorial  Review  of  Action  Trees.  This  is  an  extremely  time- 
consuming  job.  Since  the  checking  is  done  by  different 
people,  a certain  number  of  wrong  references,  inconsistencies, 
improper  punctuation,  poor  grammar,  etc.  inevitably  slip  by. 

3.  Review  Action  Trees  for  Completeness.  This  requires  con- 
siderable time,  and  involves  hand-tallies  and  voluminous 
cross-checking  between  intermediate  products  and  the 
Action  Trees.  A 100-percent  complete  review  performed  by 
humans  is  extremely  difficult,  and  affords  numerous  opportuni- 
ties for  error. 

4.  Typing  and  Proofreading.  This  requires  a great  deal  of  clerical 
time,  and  is  another  good  opportunity  for  errors  to  occur. 

The  Computer-Assisted  Performance  Aid  Development  and  Production 
(CAPADAP)  system  combines  all  four  of  these  functions  (and  a few  others) 
into  a single,  comprehensive  set  of  computer  programs.  The  following 
two  sections  provide  (1)  a short  discussion  of  traditional  JPA  develop- 
ment and  production,  and  (2)  a synopsis  of  how  the  CAPADAP  system  stream- 
lines and  vastly  tightens  quality  control  over  the  process.  (Note: 

Although  this  material  discusses  only  the  Fully  Proceduralized  Trouble- 
shooting Aid  JPAs , the  same  CAPADAP  techniques  apply  to  Job  Guide  Manuals.) 
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The  Traditional  JPA  Development/Production 
Process  and  Some  Problems 

Writing  and  Editing.  Traditional  JPA  development  begins  with  a 
detailed  task  analysis  and  proceeds  through  several  steps  to  the  devel- 
opment of  Action  Tree  diagrams.  Action  Tree  diagrams  depict  the  sequence 
of  steps  to  take  in  finding  a malfunctioning  part.  The  analyst/writer 
must  determine  what  tests  (voltage,  resistance,  etc.)  the  technician  needs 
to  make,  and  then  write  a clear  instruction  for  the  technician. 

The  outcome  of  every  test  either  tells  the  technician  to  replace  a 
part,  or  to  go  on  to  another  numbered  step.  The  other  numbered  step  may 
be  many  pages  away.  The  JPA  analyst/writer  must  leave  a blank  space  for 
the  step  number,  and  when  all  steps  are  eventually  assigned  numbers  (days 
or  weeks  later),  the  analys t/writer  must  return  and  fill  in  the  number. 

And,  if  a step  number  is  changed  somewhere  in  the  middle  of  the  step 
sequence,  each  subsequent  step  in  the  sequence  must  have  its  number  changed 
too.  The  analyst/writer  must  catch  every  step  whose  number  changes  or  the 
procedure  will  fail  when  tried. 

Once  the  Action  Tree  diagrams  are  completed,  they  must  be  reviewed 
for  editorial  integrity.  All  statements  must  be  very  clear,  simple,  and 
unambiguous.  All  figure  references  and  cross-referencing  must  be  accurate. 
For  large  JPAs,  this  is  an  awesome  task,  all  done  by  hand. 

Clearly,  the  analyst/writer  has  many  things  that  he  must  remember  to 
do,  including  keeping  the  wording  of  his  statements  consistent  and  all  his 
words  spelled  right.  And,  if  it  happens  that  JPA  development  is  concurrent 
with  hardware  development,  the  analyst/writer  must  contend  with  intermin- 
able design  alterations. 

So,  in  developing  Action  Tree  diagrams,  the  analyst/writer  could  make 
good  use  of  a file  of  "standard  statements"  that  would  keep  his  wording, 
spelling,  and  punctuation  consistent.  If  each  "standard  statement"  had 
a reference  number,  he  could  use  the  number  instead  of  having  to  write 
the  same  statement  over  and  over.  The  analyst/writer  could  also  use  a 
system  that  would  automatically  number  his  troubleshooting  steps,  and 
renumber  them  each  time  a change  occurred.  The  CAPADAP  system  does  exactly 
these  things. 

Illustrations . Often,  the  same  illustration  can  be  used  in  several 
frames.  This  is  quite  cost-effective.  But,  if  a change  is  made  to  an 
illustration  that  appears  in  14  different  places,  the  analyst/writer  must 
dig  through  all  of  his  material  to  locate  every  place  the  illustration  is 
used.  There  is  a reasonable  probability  that  he  might  overlook  a place. 

The  analyst/writer  could  certainly  use  a system  that  would  instantly  tell 
him  all  the  places  where  the  illustration  appears.  This  is  one  of  the 
computer  routines  in  CAPADAP . 

Review  for  Completeness.  Next,  the. analyst/writer  must  conduct  a 
Review  for  Completeness.  To  do  this,  he  prepares  a list  of  all  mainte- 
nance-significant components,  and  notes  the  number  of  failure  modes  (e.g., 
shorted,  open,  changed  value)  for  each.  Then  he  checks  this  list  of 
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component-failure  modes  against  his  Action  Tree  diagrams  to  make  sure  the 
Action  Trees  include  all  the  possible  failure  modes.  This  process  runs 
into  man-weeks  even  if  only  a few  hundred  frames  must  be  reviewed.  It 
must  be  done  very  painstakingly,  because  the  validity  of  the  JPAs  depends 
on  complete  coverage. 

The  Review  for  Completeness  is  a massive  undertaking,  involving 
hundreds  of  loose  papers  (the  draft  action  trees  and  intermediate  products), 
and  material  literally  "sitting  around  in  boxes."  Security  is  tenuous, 
and  documents  are  subjected  to  all  manner  of  minor  environmental  hazards. 
Misplacement  of  material  is  possible.  The  reviewers  have  to  read  various 
individual's  handwritings,  some  less  legible  than  others.  And,  the  reviewers 
must  often  work  from  photocopies  which  occasionally  obscure  crucial  letters 
and  numbers. 

It  is  excruciatingly  difficult  to  conduct  a perfect  Review  for  Com- 
pleteness, using  people.  What  is  needed  is  a system  that  automatically 
conducts  a perfect  review  and  catches  all  omissions,  does  so  without 
reviewing  reams  of  documents,  and  achieves  this  quickly.  And  that  is  what 
CAPADAP  does . 

Typing  the  Draft.  Once  the  Review  for  Completeness  is  done,  the. 

Action  Tree  diagrams  are  revised  as  needed.  Then,  a draft  is  typed  from 
the  Action  Tree  diagrams.  The  draft  must  be  proofread.  The  typing  and 
proofreading  take  much  time  and  present  a fine  opportunity  for  errors 
to  invade  the  text.  The  draft  must  be  photocopied  so  everyone  concerned 
has  a copy  to  work  with.  This  takes  more  time.  CAPADAP  can  type  error- 
free,  already-proofed  multiple  copies  of  a 1000-step  draft  in  10  minutes. 

Typing  the  Draft  Again.  The  next  step  is  validation,  during  which 
time  100  percent  of  the  Action  Tree  diagrams  are  tried  out  on  actual  gear, 
to  make  sure  they  work.  Values  (voltages,  resistances,  etc.)  are  also 
inserted  at  this  time.  The  validated  draft  must  be  typed  and  proofread 
again,  with  the  same  problems  as  in  the  first  typing.  CAPADAP  is  needed 
again. 


Understanding  the  CAPADAP  System 

The  easiest  way  to  understand  CAPADAP  System  operation  is  to  take 
an  actual  JPA  text  page  and  observe  its  steo-bv-step  development.  The 
sample  text  page  we  will  use  is  shown  in  Figure  A-9. 

Standard  Statements  (SS)  . Examine  Figure  A-9  and  you  will  notice 
that  the  same  basic  statements  seem  to  recur.  For  example,  Steps  922 
and  923  read: 

Using  Simpson  260,  connect  + test  lead  to  Q8  (10). 

Connect  COMMON  test  lead  to  ground.. 

Check  that  multimeter  indicates  between  -14.8  and  -15.2 
VDC.  If  not,  go  to  Step  950. 
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922.  Using  Simpson  260,  connect  + test  lend  to  Q8  (10).  Connect  COMMON  test  lead 
to  ground. 

I 923.  Check  that  multimeter  indicates  between  -14.8  and  -1 9. 2 VDC.  If  not,  go  to 
slop  950. 

[ 924.  Using  Simpson  260,  connect  + test  lead  to  Q8  (9).  Conned  COMMON  lest  lead 

to  ground. 

! 

925.  Check  that  multimeter  indicates  between  -6.8  and  -7.2  VDC.  If  not,  no  1o 
step  958. 

926.  Set  POWER  switch  (3)  to  OFF. 

927.  Sd  23  VDC  breaker  (I)  and  115  VAC  400  Hz  breaker  (2)  1o  OFT. 

928.  Usinq  Simpson  260,  connect  + test  lead  to  08  (6).  Conned  COMMON  ted  lead 
to  ground. 

1 

929.  Check  that  multimeter  indicates  1890  ohms  or  more.  I f nof,  replace  P.C.. 
board  6A3AI  (5);  go  to  step  I. 

| 930.  Replace  6A3AIQ8  (4),  go  to  slep  I. 

931.  Using  Sirnpson  260,  connect  + test  lead  to  Q7  (8).  Conned  COMMON  led  load 
to  ground. 

932.  Check  that  multimeter  indicates  between  14.8  and  15.2  VDC.  If  not,  go  lo 
step  968. 

933.  Using  Simpson  260,  connect  + test  lead  lo  Q 7 (7).  Connect  COMMON  tod  lead 

j to  ground. 

j 934.  Check  that  mull i meter  indicates  between  6.8  and  7.2  VDC.  If  nol , go  lo 
step  976. 

935.  Sot  F0WI  R switch  (3)  lo  OFF. 

936.  Set  28  VDC  breaker  (I)  and  115  VAC  400  Hz  breaker  (2)  to  OFF. 


1-218 


Figure  A-9.  A Sample  JPA  Text  Page 
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Steps  924  and  925  use  the  same  basic  statement: 

Using  Simpson  260,  connect  + test  lead  to  Q8  (9) . 

Connect  COMMON  test  lead  to  ground. 

Check  that  multimeter  indicates  between  -6.8  and  -7.2 
VDC.  If  not,  go  to  Step  958. 

The  only  differences  between  the  two  statements  are  the  "connect  + test 
lead  to"  point  and  callout,  the  voltages,  and  the  next  step  to  go  to. 

If  blanks  are  substituted  for  these  elements,  we  have: 

Using  Simpson  260,  connect  + test  lead  to  ( ) . 

Connect  COMMON  test  lead  to  ground. 

Check  that  multimeter  indicates  between  and 

. If  not,  go  to  . 

This  is  a statement  which  can  be  used  many  times  in  many  places,  by  simply 
inserting  the  four  missing  elements.  It  is  called  a "standard  statement." 

In  JPA  writing,  many  such  "standard  statements"  are  used.  In  fact, 
the  ma j ority  of  statements  used  in  JPAs  (more  than  80  percent  in  some- 
books)  are  repetitive  "standard  statements."  A close  study  of  Figure  A-9 
reveals  that  only  four  standard  statements  are  reauired  for  the  entire 
page.  These  four  standard  statements  are  shown  in  Figure  A-10. 

When  CAPADAP  is  to  be  used  in  a JPA  production  project,  the  first 
step  is  to  prepare  a list  of  appropriate  Standard  Statements  (SS)  . Each 
SS  is  assigned  a Code  Number  for  reference. 

The  computer  now  has  in  storage  a file  of  letter-perfect  SS  that 
will  be  used  time  and  again  throughout  the  JPAs.  These  SS  reouire  no 
further  attention.  A large,  portion  of  the  JPA  editing  is  now  complete. 

Now  the  JPA  analyst/writers  can  begin  preparing  the  Action  Tree 
diagrams.  A sample  is  shown  in  Figure  A-ll.  The  analys t /writer  analyzes 
the  circuit,  and  sees  that  the  technician's  first  step  must  be  to 
measure  the  VDC  between  Q8  and  the  ground,  using  the  Simpson  260  multi- 
meter. The  analyst/writer  flips  through  his  printout  of  the  computer's 
SS  File,  and  finds  what  he  needs:  SS  #9  (see  Figure  A-10).  Instead  of 
having  to  write  out  the  full  statement,  he  simply  writes  "SS  it 9"  on 
the  Action  Tree  diagram.  Then,  he  notes  the  data  needed  to  fill  in  the 
blanks  of  SS  it 9:  Q8  (what  the  + test  lead  connects  to),  and  AT12-6 
(the  next  point  in  Action  Tree  Itl2  to  which  the  technician  must  proceed)  . 
Note:  The  callout  number  in  parentheses  is  added  during  formatting;  the 
VDC  values  are  added  during  validation. 

The  analyst/writer  then  moves  to  the  next  check  the  technician  must 
make,  looks  up  the  appropriate  SS,  notes  the  SS//  in  the  next  block  of  the 
Action  Tree  diagram,  and  records  the  data  needed  to  fill  the  blanks  in  this 
SS. 
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43. 


STANDARD  STATEMENT 


Using  Simpson  2G0,  connect  + test  lead  to  ( ). 

Connect  COMMON  test  lead  to  ground. 

Check  that  multimeter  indicates  between 

and  _.  If  not,  go  to  . 


Using  Simpson  260,  connect  + test  lead-  to  ( ). 

Connect  COMMON  test  lead  to  ground. 

Check  that  multimeter  indicates  or  more.- 

If  not,  replace  ( ) ; go  to  . 


Replace 


) . Go  to 


Set  POWER  switch  ( ) to  OFF. 

Set  28  VDC  breaker  ( ) and  115  VAC  400  Hz  breaker  ( ) 
to  OFF. 


I 

i 

i 


i 
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Figure  A- 10.  Standard  Statements  for  the 
Sample  JPA  Text  Page 
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"Writing"  the  Action  Tree  diagrams  in  this  way  is  simple.  Advan- 
tages: 

1.  It  is  fast  (SS  numbers  are  written  instead  cf  whole 
sentences) . 

2.  It  makes  changes  of  SS  easy  (only  the  SS  number  is 
corrected,  instead  of  erasing  and  rewriting  whole 
sentences) . 

3.  It  prevents  inconsistent  versions  of  steps  from 
different  analyst/writers  (no  matter  which  writer 
prepares  an  Action  Tree  diagram,  the  SS  will  always 
be  identical). 

4.  A much  higher  percentage  of  the  analyst/wr iter ' s time 
is  spent  on  technical  matters,  while  lowering  the 
total  "technical  writing"  time  per  frame. 

The  analyst/writer's  Action  Tree  diagrams  now  go  to  the  Computer 
Terminal  Operator  (CTO) . The  CTO  prepares  a computer  file  that  contains 
all  the  values  needed  to  fill  in  all  the  blanks  in  all  the  SS.  This 
file  is  the  "Logic/Value  File." 

Non-Standard  Statements  (NS).  What  happens  if  the  JPA  analyst/ 
writer  scans  his  list  for  an  appropriate  SS  and  can't  find  one?  This 
occurs  occasionally  because  a particular  test  may  be  made  only  once  in 
the  entire  system.  In  this  case,  the  analyst/writer  must  generate  a 
unique  "Non-Standard  Statement"  (NS) . 

The  analyst/writer  composes  the  statement  and  writes  it  beneath  the 
block  on  the  Action  Tree  diagram.  He  assigns  a NS  Code  Number  to  it  (24 
in  this  case) . In  the  block,  he  notes  the  same  type  of  data  that  he 
normally  writes  in  SS  blocks.  When  this  Action  Tree  diagram  reaches  the 
CTO,  the  CTO  will  see  the  Non-standard  Statement.  The  CTO  then  generates 
another  computer  file,  the  "NS  File."  The  NS  and  its  Code  Number  are 
typed  into  the  computer  and  the  data  required  to  fill  the  blanks  in  the 
NS  are  entered  into  the  computer's  Logic/Valuc  File.  Once  all  Non-stan- 
dard Statements  for  the  whole  system  are  in  the  NS  File,  a printout  of 
the  file  is  run,  edited,  and  corrections  are  typed  into  the  computer. 

Now  all  NS  used  In  the  JPAs  are  letter-perfect  and  need  not  be  reviewed 
again. 

CAPADAP's  Instant  Quality  Checks.  At  this  point,  the  entire  JPA 
"draft"  is  complete  (except  for  values  and  callouts),  edited,  and  stored 
in  three  files  in  the  computer  (the  SS  File,  NS  File,  and  Logic/Value 
File).  Before  a printout  of  the  draft  is  run,  however,  two  internal 
computer  reviews  are  run: 

1.  Logic/Value  File  Review 

2.  Review  for  Completeness. 
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These  reviews  are  outstanding  features  of  CAPADAP  and  are  the  functions 
that  so  dramatically  enhance  development/production  quality  control.  The 
following  paragraphs  explain  what  the  reviews  achieve. 


Logic/Value  File  Review.  This  review  checks  the  Logic/Value  File  to 
see  if  its  contents  makes  sense.  The  computer  searches  through  the  Logic/ 
Value  File,  and  checks  for  a variety  of  errors.  The  Review  examines  24 
different  dimensions,  the  most  essential  of  which  are: 

1.  "Go  to  " instructions.  Does  the  Logic/Value 

File  contain  a "go  to"  point  for  all  of  these  instructions? 

Were  any  left  blank?  Do  all  the  "go  to"  points  in  the  file 
actually  exist?  Has  the  writer  inadvertently  assigned  the 
same  designation  to  two  different  "go  to"  points? 

2.  The  Action  Tree  diagram  blocks.  Are  any  of  the  steps 
within  an  Action  Tree  diagram  out  of  sequence? 

3.  In  each  Logic/Value  File  entry,  an  SS  or  NS  is  referenced. 

Are  the  referenced  statements  actually  in  the  SS  and  NS 
Files? 

4.  If  an  SS  has,  say,  three  blanks,  are  there  three  data  items 
in  the  Logic/ Value  File  for  those  blanks?  Were  any  omitted, 
or  are  there  too  many?  (All  SS  and  NS  are  checked.) 

5.  Are  the  values  in  the  Logic/Value  File  the  right  type  for 
their  assigned  blanks  in  each  SS  and  NS? 

If  the  Logic/Value  File  Review  discovers  any  discrepancies,  the 
computer  prints  out  a list  of  them,  stating  what's  wrong  and  exactly  where. 
It  is  a simple  matter  to  take  this  discrepancy  list,  run  down  the  problems 
with  the  analyst/writer  or  CTO,  and  type  corrections  into  the  computer. 

Once  this  is  done,  the  Logic/Value  File  has  no  "holes." 

Review  for  Completeness.  The  Logic/Value  File  Review  established 
that  chere  are  no  discrepancies  among  the  computer  concents.  But  are 
we  sure  that  everything  is  in  the  computer  that  should  be?  The  Review 
for  Completeness  is  the  second  "instant  quality  check."  It  makes  sure 
all  components  have  the  right  number  of  statements  for  the  number  of  ways 
the  component  can  fail.  See  Figure  A-12,  Example  Failure  Modes. 

To  perform  this  review,  a list  of  function  failures  is  prepared  and 
entered  into  the  computer.  The  computer  scans  its  Logic/Value  File, 
looking  only  at  steps  where  components  are  replaced.  It  tallies  the 
number  of  times  each  component  is  replaced.  It  also  notes  any  components 
it  finds  being  replaced  that  aren't  in  the  function  failure  list.  The 
computer  then  prints  out  another  discrepancy  list  which  itemizes  all 
discrepancies  and  states  where  they  occur.  The  analyst/writer  takes  the 
list,  runs  down  the  problems,  and  has  corrections  typed  into  the  computer. 

Like  the  Logic/Value  File  Review,  this  Review  for  Completeness  has 
accomplished  in  minutes  what  used  to  take  weeks.  But  most  importantly, 
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the  Review  for  Completeness  has  caught  every  discrepancy  and  established 
the  final  quality  of  the  JPAs. 


Illustration  Review.  Another  important  check  is  also  made:  the 

Illustration  Usage  Analysis.  The  computer  is  commanded  to  print  out  a 

list  of  all  illustrations  used  in  the  JPAs,  indicating  how  many  times 

each  is  used,  and  where  it  is  referenced  in  the  text.  This  information 

will  be  used  where  validation  indicates  that  an  illustration  should  be 

changed,  to  assure  that  all  occurrences  of  the  illustration  are  changed. 

Also,  this  list  gives  the  JPA  production  manager  a precise  tally  of  how 

many  times  each  illustration  is  required.  The  computer  also  detects 

illustrations  that  are  never  used,  and  flags  these. 

■ 


Validation.  The  JPA  steps  are  now  tried  out  on  actual  equipment. 
There  will  be  inevitable  changes,  adding  and  deleting  steps  and  series 
of  steps.  Deleted  steps  are  simply  erased  from  the  SS,  NS,  and  Logic/ 
Value  Files.  Added  steps  are  handled  like  the  original  Action  Tree  dia- 
grams: find  the  applicable  SS  in  the  list  (or  create  an  NS,  if  needed), 

record  the  statement's  Code  Number  and  the  values  for  its  blanks,  and 
have  the  CTO  type  it  into  the  computer.  It  alterations  disturb  the 
draft  step-number  sequence,  the  computer  will  automatically  renumber  the 
steps . 


Also  during  validation,  the  missing  values  (voltage,  resistances, 
etc.)  and  associated  tolerances  are  determined  and  plugged  into  the  draft. 
The  CTO  types  these  values  into  the  computer,  which  adds  them  to  its 
Logic/Value  File. 


One  of  the  major  values  of  the  computer  system  is  that  validation  is 
entered  with  a draft  more  nearly  complete  and  correct  than  has  been  possible 
heretofore.  This  results  in  a dramatic  reduction  in  interruptions  to  make 
corrections,  and  thus  in  much  more  efficient  use  of  equipment  access  time. 
And,  there  is  a concomitant  reduction  in  the  calendar  time  which  would 
otherwise  be  required  for  validation. 

Formatting . If  the  first  draft  has  not  been  seriously  altered  by 
validation,  it  can  be  used  for  formatting.  If  it  has  been  extensively 
changed,  a fresh  draft  incorporating  the  validation  changes  can  be  obtained 
as  quickly  as  the  initial  draft. 

Analyst/writers  now  go  over  the  draft,  coordinating  the  illustrations 
with  appropriate  JPA  steps.  They  mark  the  draft  to  indicate  page  breaks, 
and  insert  callout  numbers  in  the  text  parentheses.  The  CTO  types  the 
page  breaks  and  callout  numbers  into  the  computer  Logic/Value  File.  This 
completes  the  contents  of  this  file. 

Verification  and  the  Final  Copy.  The  JPA  draft  can  now  be  verified 
with  a user  tryout.  Corrections,  if  any,  are  made  in  the  same  way  as  those 
resulting  from  validation.  Finally,  when  everyone  is  satisfied  with  the 
JPA  draft,  the  computer  is  given  a command  to  print  out  camera-ready  final 
copy  over  a low-speed,  high  quality  printer  located  in  ASA's  Computer 
Terminal  Room.  If  any  transmission  difficulties  occur,  the  printer  has 
error-detectors  which  alert  the  CTO  to  the  problem. 
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The  previous  discussion  says  nothing  of  the  logic  of  the  JPA — only 
the  process  of  writing  and  editing  them  using  CAPADAP.  The  logic  of  the 
JPA  in  the  present  program  was  governed  by  the  rules  stated  below. 


Action  Tree  Development  Rules 

1.  Develop  the  branching  Action  Tree  by  choosing  Test  Instrument, 
Type  of  Test,  and  Location  of  Test  for  each  Test/Decision  3ox 
as  provided  for  in  3.4.11.1. c of  the  specification.  Refer  to 
the  Test  Equipment  and  Tool  Use  Form  which  defines  the  items 
that  are  officially  authorized  for  use  by  maintenance  personnel. 
Selection  of  test  instruments  must  be  limited  to  those  items 
found  on  this  form.  The  form  will  also  provide  a list  whenever 
special  test  equipment  is  called  for. 

2.  Selection  of  the  correct  test  locations  is  of  primary  importance. 
Test  locations  should  be  selected  in  such  a way  as  to  divide  the 
blocks  on  the  Component  Block  Diagram  (CBD)  into  two  segments 
with  equal  (as  nearly  as  possible)  probability  of  containing 

the  malfunction.  For  the  CBD  shown  below: 


The  first  test  location  would  be  at  point  A)  since  the  choice 
permits  dividing  the  components  most  equally.  No  other  test 
point  permits  better  than  an  8-3  split.  If  a "good"  indication 
is  found  at  <A)  , the  second  test  should  be  at  (¥)  or  (cf)  . 

If  a "bad"  indication  is  found  at  (A)  , the  second  test' should 
be  at  (D)  . Each  check  eliminates  about  half  of  the  components 

from  consideration.  These  components  are  known  to  be  "good."  The 
choice  of  test  location  between  the  suspect  components  should  be 
such  that  the  check  be  made  at  the  mid-point  of  the  chain,  and 
each  succeeding  check  be  made  at  the  mid-point  of  the  remaining 
portion  of  the  chain.  Thus,  assuming  each  component  has  an  equal 
probability  of  failure,  the  branching  proceeds  by  halving  the 
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probabilities  that  the  malfunctioning  LRI  lies  on  one  side  or  the 
other  of  the  check.  This  strategy  defines  the  half-split  technique 
of  troubleshooting.  The  half-split  technique  should  be  modified 
by  introducing  the  following  considerations: 

Accessibility  - Checks  that  are  easy  to  make  should  be 
made  early  in  the  tree.  Checks  that  involve  extensive  or 
difficult  disassembly  should  be  written  toward  the  end  of 
the  tree.  The  accessibility  consideration  adds  a practical 
dimension  to  half-splitting,  since  time  required  to  perform 
the  check  is  also  a measure  of  action  tree  efficiency. 

Accidental  Malfunction  Introduction  - Those  checks  which 
have  a high  probability  of  introducing  accidental  equipment 
damage  should  be  sacrificed  for  less  efficient  checks  when- 
ever possible.  If  there  are  no  other  equivalent  checks,  a 
damage-likely  check  should  be  deferred  toward  the  end  of 
the  tree . 

Refer  to  the  Test  Equipment  and  Tool  Use  Form  each  time  a 
procedural  step  calls  for  the  use  of  a special  tool  or  piece 
of  test  equipment.  Be  certain  that  the  procedural  steps  con- 
tain all  control  settings  or  other  operating  instructions 
required  by  the  form  each  time  a special  tool  or  piece  of  test 
equipment  is  used. 

3.  When  developing  strategies  for  within-stage  troubleshooting  of 
solid  state  devices  or  other  direct  coupled  stages,  the  follow- 
ing considerations  apply: 

a.  Using  half-split  technique,  check  output  of  all  suspect 
stages.  Bad  stages  are  denoted  by  a good  indication 
immediately  followed  by  a bad  indication. 

b.  When  a stage  is  suspect,  isolate  it  by  disconnecting  the 
load.  Recheck  the  previously  bad  indication.  If  indica- 
tion is  now  good,  begin  troubleshooting  the  following 
stage.  If  indication  is  still  bad,  troubleshoot  the 
suspected  stage. 

c.  When  we  find  that  after  isolating  a suspect  stage  from  its 
load,  it  is  the  load  (following  circuit,  input)  that  is 
defective,  we  should  use  the  following  strategy:  First, 
test  the  input  terminals  of  the  defective  stage's  active 
component.  If  input  tests  are  bad,  remove  active  device 
and  check  input  circuit  passive  components.  If  a passive 
component  as  well  as  the  active  one  has  failed,  replace 
them  both  and  direct  the  user  to  repeat  the  previous  stage 
output  test.  If  the  output  test  is  now  passed,  the  user 
should  be  directed  to  return  to  the  checkout  and  proceed. 
However,  if  the  stage  output  test  is  failed  a second  time 
after  the  repair  should  have  been  effected,  the  user  should 
be  directed  to  obtain  assistance. 
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This  approach  is  somewhat  different  than  ones  used  in  the 
past  and  the  emphasis  is  on  shortening  maintenance  technician 
feedback  time  in  difficult  repair  situations.  Rather  than 
being  sent  from  the  repair  directly  back  to  the  check  to 
start  over,  the  change  has  the  technician  repeat  the 
previously  failed  (stage  specific)  check.  If  this  check 
is  now  satisfactory,  the  technician  is  permitted  to  return 
to  the  checkout  and  proceed.  If  not,  either  the  technician 
committed  a procedural  error  or  he  further  damaged  the 
equipment  while  effecting  the  repair.  In  either  case, 
it's  a matter  for  his  supervisor  to  decide. 

The  same  final  sequence  (beginning  with  repeat  the  stage 
output  test)  should  be  performed  if  only  a passive  com- 
ponent has  failed,  or  if  only  an  active  component  has 
failed. 

d.  The  final  sequence  just  described  for  troubleshooting  is 
appropriate  for  any  direct-coupled  circuit.  The  previous 
case  only  considered  the  input  circuit,  since  it  was 
loading  the  output  of  the  preceding  stage.  When  the 
defect  is  located  within  the  stage  that  originally 
appeared  defective,  it  is  first  necessary  to,  in  circuit, 
check  the  junctions  of  the  active  component.  For  a 
transistor,  this  means  five  checks:  base  to  emitter, 
forward  and  reverse;  base  to  collector,  forward  and 
reverse;  collector  to  emitter,  reverse.  In  each  of  the 
junction  checks,  if  a fault  is  found,  the  associated 
external  (passive)  circuit  must  also  be  checked.  The 
possibles  in  this  case  include  a passive  component  as 
well  as  the  active  one. 

If  the  active  circuit  checks  out  properly,  the  peripheral 
passive  components  will  remain  suspect  and  must  be  checked 
out  conventionally. 

Two  procedures  taken  from  the  JPA  manuals  used  in  the  AQA-7  program 
follow: 


Checkout  and  Troubleshoot  of  a Voltage  Regulator  Assembly. 
Replacement  of  a CRT  Assembly. 
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SECTION  IV 


4-1 


13PS3  REGULATOR  ASSEMBLY  VOLTAGE  FORM  35V. 

4-1.  preliminary  CONDITIONS ■ 

4-2.  This  procedure  covers  the  Check- 
out and  Troubleshooting  of  the  13PS3 
Regulator  Assembly  Voltage  PORM  35V, 

PORM  15V,  and  -10V. 

4-3.  APPLICABLE  PART  AND  SERIAL 
NUMBERS. 

4-4.  This  procedure  is  effective  for 
Part  No.  535105-801. 

4 - 5 . SPECIAL  TOOLS  AND  TEST  EQUIPMENT . 

4-6.  The  special  tools  and  test  equip- 
ment required  for  performance  of  this 
procedure  are: 

-Simpson  260  Multimeter 

-Tektronix  454  Oscilloscope 

-Fluke  8300A  Digital.  Voltmeter 

-AN/AQM-20 

4-7.  SUPPLIES. 

4-8.  The  materials  required  for  per- 
formance of  this  procedure _ are  Mainte- 
nance Action  OPNAV  Forms  4790/40  and 
4790/41. 

4-9.  PERSONNEL  REQUIREMENTS . 

4-10.  One  AQA-7  Job-Oriented  Training 
Graduate  is  required  to  perform  this 
task. 

t 

4-11.  EQUIPMENT  CONDITIONS . 

4-12.  Prerequisite  to  the  performance 
of  this  procedure  are  the  following 
equipment  conditions: 

-The  60  Hz  and  400  Hz  circuit 
breakers  l.ocated  on  the  CONSOLE 
POWER  PANEL  are  set  to  ON. 


PORM  15V,  -10V,  CHECKOUT  ANT)  TROUBLESHOOT 

-The  60  Hz  and  400  Hz  switches 
located  on  the  CONSOLE  POWER 
PANEL  are  set  to  ON. 

-The  60  Hz  and  400  Hz  POWER 
switches  located  on  the  SIGNAL 
PANEL  are  set  to  OFF. 

-The  DC  and  400  Hz  POWER  switches 
located  on  the  TEST  POWER  CONTROL 
are  set  to  OFF. 

-The  U/0V  VOLTAGE  TEST  switch 
is  set  to  1. 

-The  1A7PS1,  1A7PS2,  1A8PS1,  and 
1A8PS2  circuit  breakers  are  sot 
to  ON. 

-I  Limit  on.  1A7PS1,  1A8FS1,  and 
1A8PS2  has  been  rotated  to 
clockwise,  extreme. 

-All  rotary  switches  on  the  load 
control  drawer  have  been  set  in 
extreme  counterclockwise  position . 

-The  409  Hz  POWER  switch  located 
on  the  TEST  POWER  CONTROL  is 
set  to  ON. 

-The  3 phase  AC  ADJUST  located  on 
TEST  POWER  CONTROL  has  been 
adjusted  for  115  VAC. 

-The  400  Hz  POWER  switch  located 
on  TEST  POWER  CONTROL  is  set  to 
OFF. 

-The.  DVM  SELECT  switch  is  sec  tc  OFF 

4-13.  NOTES , CAUTIONS.  AND  WARNINGS . 

4-14  . No  general  NOTE,  CAUT ' ON , cr 

WARMING  applies  to  this  procedure. 

4-15.  ACTIVITY  INDEX. 

4-16.  Activities  covered  in  this 
manual  are  listed  in  the  AN/AQA-7 
Manual  Index  which  appears  at  tie 
beginning  of  this  manual. 
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CHECKOUT  AND  TROUBLESHOOT 


07.  Cnee*,  that  displayed  61.  Set  and  hold  LOAD  switch 

wave  torn'  is  similar  to  Cl).  (4)  to  HIGH. 

If  not,  replace  13PS3C3  C3); 

go  to  step  1.  62.  Checw.  that  DVM  indicates 

Detween  - H . 7 and  -9.7  VDC.  If 
SB.  Set  P * R SUPPLY  LOAD  switen  not,  qo  to  step  2S1. 

C S ) t o 1 . 

63.  Release  LOAD  switch. 

69.  Set  ana  hold  LOAD  switch 

(4)  to  LO*.  64.  Set  PWR  SUPPLY  LOAD  switen 

C 5 ) to  2 . 

60.  Cn.ec,'.  that  D V Hi  indicates 

between  ■ B . 7 and  -9.1  VDC.  If  65.  Set  and  hold  LOAD  switch 

not,  goto  step  251.  C4)toL0w. 
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1 3 k S 3 AEG JLATOk  h.S  SEMRLY  VOLTAGE  PORM  -35V,  FORM  15V,  -10V, 

CHECKOUT  AND  TROUBLESHOOT 


6 1> . C h e c K t h a t 0 V M 1 n 0 i c a t e s 
between  +14.3  and  +15.7  VDC. 
If  non,  go  to  Stef?  318. 

f> 7 . Set  and  hold  LOAD  switch 
(4)  to  HIGH, 

63.  Cnec<  that  dvm  indicates 
between  +14  and  +16  VDC.  If 
not,  ao  to  step  3 1 0 . 


69. 

Release 

LOAD 

switch 

70. 

Set  VOLT/DI  V 

switch 

mV , 

set 

T 1 M E / n I V 

S wi  t 

ch  to  2 

Set  TRIGGERING  SOURCE  to  1NT. 
Set  COUPLING  switch  to  AC. 

71.  C n e c ic  that  Displayed 
waveform  is  similar  to  C 6 ) . 

If  not,  replace  13PS3C4  (2); 
go  to  step  1. 


I 
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SECTION  VI 

6A2  ELECTRON  TiJB2  ASSEMBLY , REPLACE 


6-1.  PRELIMINARY  CONDITION'S . 

6-2.  This  procedure  covers  Che 
replacement  of  the  6A2  Electron  Tube 
Assembly. 

6-3.  APPLICABLE  PART  AND  SERIAL 
NUMBERS. 

6-4.  This  procedure  is  effective  for 
1P931,  PN  709570-801. 

6-5.  SPECIAL  TOOLS  AND  TEST  EQUIPMENT. 

6-6.  The  special  tools  and  test  equip- 
ment required  for  performance  of  this 
procedure  are: 

-Pin  Extractor  Tool  TS-39025 
-Pin  Insertion  Tool  TS-38025 

-1  O11  '!/"»  0 PKi  1 1 i nq  C rs  v /■>».»  s r r\  v* 

6-7.  SUPPLIES. 

6-8.  The  materials  required  for  per- 
formance of  this  procedure  are  Mainte- 
nance Action  OPNAV  Forms  4790/40  and 
4790/41,  wire  marking  tags,  and  a 
storage  container  for  used  CRT. 

6-9.  PERSONNEL  REQUIREMENTS. 

6-10.  One  AQA-7  Job-Oriented  Training 
Graduate  is  required  to  perform  this 

task . 
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EQUIPMENT  CONDITIONS . 


6-12.  Prerequisite  to  the  performance 
of  this  procedure  are  the  following 
equipment  conditions: 

-The  AN/AQM-18  23  VDC  and  115  VAC 
switches  are  set  to  OFF. 

-The  BFI  to  be  serviced  is 
disconnected  from  the  TBH  and 
placed  on  a convenient  work 
surface. 


6-13.  NOTES,  CAUTIONS,  AID  WARNINGS. 


6-14.  The  following  NOTE  and  WARNING 
apply  to  this  procedure: 

NOTE 

When  finished  replacing  CRT,  check 
with  your  supervisor  about  proper 
handling  and  disposal  of  the  used 
CRT. 


WARNING 


To  prevent  possible  serious  injury, 
avoid  striking  or  damaging  exposed 
glass  portions  of  CRT  during  removal 
and  installation. 

6-15.  ACTIVITY  I NT  ~X  . 

6-16.  Activities  covered  in  this 

*-  ' 

Manual  Index  which  appears  at  the 
beginning  of  this  manual. 
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6 A 2 ELECTRON  TUBE  ASSEMBLY,  REPLACE 


Remove  the  Electronic  Tuoe  Assembly 

1.  Loosen  four  thumbscrews 
(2)  . 


2. 

H e move 

6 A 3 (1). 

3. 

Loosen 

four  screws  ( 4) . 

4 . 

Remove 

HA4  (5)  and  6A5  (3) 

5 . 

Remove 

twelve  screws  (12). 

6 . 

Remove 

bezel  (13). 

7 . 

Rotate 

TRACE  A THRESHOLD 

con 

trcl  ( 1 

0)  fully 

counterclockwise. 


14 


8,  Loosen  two  setscrews  C 1 4 
on  TRACE  A THRESHOLD  knob 
(10).  Remove  knob  (10). 

9.  Rotate  TRACE  C THRESHOLD 
control  (9)  fully 
counterclockwise. 
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6 A 2 ELECTRON  TUBE  ASSEMBLY,  REPLACE 
Remove  trie  Electronic  Tune  Assembly 


10.  Loosen  two  setscrews  (14) 
on  TRACE  C THRESHOLD  Knoo  (9). 
Remove  Knob  1 9 ) . 

11.  Rotate  VIDEO  INTENSITY 
control  (7)  fully 
counterclockwise. 

12.  Loosen  two  setscrews  (15) 
on  VIDEO  INTENSITY  knoo  (7). 
Remove  knoo  ( 7 ) . 

13.  Rotate  CURSOR  INTENSITY 
control  (6)  fully 
counterclock  v;ise. 

14.  Loosen  two  setscrews  (35) 
on  CURSOR  INTENSITY  knob  (6). 
Remove  knob  (6), 

15.  Remove  twelve  screws  (11) 

CfidLIltfti 

When  removinq  edge  panel, 
carefully  pry  panel 
for war  a to  prevent  damage 
to  panel  and  hidden  power 
plug. 


16.  Remove  pane  1 ( 8 ) . 

17.  Remove  fifteen  screws 
( 16)  . 

cainaii 

When  removing  panel,  pull 
panel  straiant  out 
approximately  four  inc.nes 
to  prevent  damaoino  switcn 
terminals  on  rear  of 
panel . 

1 8 . Remove  panel  (17). 

exilian 

Use  caution  when  moving 
chassis  to  prevent  damage- 
to  panel  wiring  and  switch 
terminals. 


19. 

Remove 

eight  screw? 

20. 

Remove 

cover  (18). 
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■ A 2 ELECTRON  TUBE  ASSEMBLY # REPLACE 
:?sove  trie  Electronic  T u o e Assemoly 


21.  Disconnect  6A2P6  Cl)  from 
6J5  . 

22.  Using  pin  extractor  tool 
T S 3 9 0 2 5 * remove  and  tag  lead 
(3)  from  X A 3 P 1 (2). 

23.  Usincr  pin  extractor  tool 
T S 3 9 0 2 5 . remove  and  tag  lead 
Co)  iron  X A 3 P 1 C 2 ) . 

24.  Using  pin  extractor  tool 
I. >39025.  remove  and  tag  lead 
(5)  from  XA3P1  C2). 


a 


25.  Using  pin  extractor  t 
TS39025 , remove  and  tag  le 
(4)  from  XA3P1  (2)  . 

26.  Remove  screw  C8). 

27.  Remove  ten  screws  C9) 
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6A2  ELECTRON  TUBE  ASSEMBLY,  REPLACE 


Remove  tne  Electronic  Tuoe  Assemoly 

28.  Remove  cover  (10), 

29.  Disconnect  6A2P1  (11)  from 
6 A fa  • J 1 . 

30.  Remove  screw  (12). 

31.  Remove  tnree  screws  (7). 


32.  Remove  CRT  assembly  (13) 
throuan  front  of  cnassis. 

33.  Place  CRT  assembly  in 
padded  container  to  prevent 
damage. 

34.  REMOVE  ENDS  HERE 


iiAtiuLiu 


To  prevent  possiole  serious 
injury,  avoiu  striking  or 
damaging  exposed  glass  .portions 
of  Cm' i during  removal  and 
installation. 
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5 A 2 ELECTRON  TUBE  ASSEMBLY,  FEPLACE 


install  the  Electronic  Tube  Assembly 


dAJ.iil.Li-J 

To  prevent  possible  serious 
injury,  avoid  striking  or 
daiiayiny  exposed  glass  portions 
of  CiM  during  removal  and 
installation. 

35.  Position  CRT  assembly  (31 
with  6A2P1  (2)  facing  down. 

36.  Install  CPT  assembly  (3) 
through  front  of  chassis. 

37.  Guide  6A2P1  (4)  through 
port  ( 5 ) . 

38.  Install  screw  (6). 

39.  Install  three  screws  ( 7 ) . 


40.  Install  screw  (3). 

41.  Reconnect  6A2P1  (4)  to 
6A6J  1 . 

42.  Install- cover  (13)  and 
secure  with  ten  screws  (9). 

43.  Reconnect  6A2P6  (1)  to 
6 J5 . 

44.  Using  pin  insertion  tool 
TS38025,  insert  lead  (13;  into 
connector  XA3P 1 (ll). 
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6A2  ELECTRON  TUBE  ASSEMBLY  / REPLACE 
Install  the  Electronic  Tube  Assembly 


45.  Using  pin  insertion  tool 
T s 3 8 0 2 5 # insert  lead  (14)  into 
connector  X A 3 P 1 (11). 

46.  Using  pin  insertion  tool 
TS39025,  insert  load  (15)  into 
connector  X A 3 P 1 ( 1 1 ) . 

47.  Using  pin  insertion  tool 
TS38025,  insert  lead  (12)  into 
connector  X A 3 P 1 (11). 


48.  Install  cover  (16)  and 
secure  with  eight  screws  (17) 

49.  CnecK  that  panel  wiring 
and  connectors  are  not 
damaged.  If  damaged,  repair 
or  replace  wiring  and 
connectors  as  necessary. 
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6 A 2 ELECTRON  TUBE  ASSEMBLY,  REPLACE 
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install  the  Electronic  Tube  Assembly 

50.  Install  oane  1 (6)  and 
secure  with  fifteen  screws 
Cl). 

c6HLi.an 

then  installing  edge 
panel,  c h e c k t n a t power 
plug  is  nrooerly  aligned 
before  securing  panel. 

51.  Install  panel  (11)  and 
secure  with  twelve  screws 
(12)  . 


52.  Install  bezel  (14)  ana 
secure  witn  twelve  screws  (7). 

53.  Rotate  TRACE  A THRESHOLD 
control  (5)  fully 
counterclockwise. 

54.  Install  TkACE  A THRESHOLD 
knob  (13)  with  position  dot 
set  to  OFF.  Secure  with 
setscrews  (15). 

55.  Rotate  TRACE  C THRESHOLD 
control  (4)  fully 
counterclockwise. 
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6 A2  ELECTRON  TUBE  ASSEMBLY , REPLACE 
Install  tne  Electronic  Tube  Assembly 


56,  Install  TRACE  C THRESHOLD 
knob  (10)  with  position  aot 
set  to  OFF.  Secure  with 
setscrews  (15). 


57.  Rotate  VIDEO  INTENSITY 
control  (3)  fully 
counterclockwise. 


53.  Install  VIDEO  INTENSITY 
knob  and  secure  with  setscrews 
(9)  . 


59,  Rotate  CURSOR  INTENSITY 
control  (2)  fully 
counterclockwise. 


60.  Install  CURSOR  1NTENSIT 
knob  and  secure  with  setscre 
(8)  . 


61.  Install  6 A 3 (16)  and 
secure  with  four  screws  (17) 


62.  Install  6 A. 4 (20)  and 
secure  w i t n screws  (13). 


63.  Install  6A5  (19)  and 
secure  with  screws  (13). 


64.  END  OF  ACTIVITY 
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Training  Development 


Introduction 

The  training  development  effort  had  several  objectives,  some  of 
which  were  unique  to  this  program.  The  audience  was  to  be  Navy  recruit 
training  graduates  with  no  prior  training  or  experience  in  electronics. 

The  intelligence  and  aptitudes  of  this  audience  were  average.  As  such, 
they  would  not  have  been  eligible  for  electronics  training  in  the  Navy 
except  for  this  program.  The  objective  was  to  teach  only  those  skills 
and  knowledges  required  to  permit  them  to  perform  their  tasks  using 
specialized  technical  data — the  JPA.  Since  that  data  obviated  the  need 
for  them  to  perform  some  of  the  tasks  which  conventional  technicians  are 
sometimes  called  upon  to  perform,  the  training  did  not  need  to,  and  did 
not,  treat  a variety  of  subject  matter  areas  frequently  found  in  more 
conventional  electronic  training  materials.  Some  examples  are: 

. Atomic  theory 
. Electronics  math 
. Data  flow  analysis 
. Electron  flow  tracing 

Signal  parameter  estimating 
. Unnecessary  vocabulary 

The  training  focused  on  manual  skills,  such  as  soldering,  hand-toci 
use,  assembly  and  disassembly;  system  geography,  i.e.,  the  location  of 
components  in  the  aircraft  and  on  the  test  bench;  fluency  in  use  c?  the  JPA; 
and  accuracy  in  use  of  test  equipment. 


Training  Development  Process 

The  process  by  which  the  training  was  developed  is  schematized  in 
Figure  A- 13. 


Training  Content 

A task  analysis  of  AQA-7  maintenance  functions  was  done  on  a pre- 
vious project  (Navy  Contract  No.  N62269-73-C-0176) . Results  of  this 
task  analysis  defined  what  had  to  be  done  by  technicians  to  maintain 
the  system.  The  initial  project  also  produced  a sample  JPA  for  one 
of  the  AOA-7  prime  equipment  units,  the  Bearing  Frequency  Indicator 
(BFI) . These  two  products,  the  task  analysis  and  the  sample  JPA, 
provided  one  major  source  of  information  for  decisions  about  training 
program  content.  A review  of  the  two  documents  quickly  revealed,  for 
example,  that  in  order  to  use  the  JPA  for  maintaining  the  system, 
technicians  would  have  to  know  how  to  use  certain  test  equipment  and 
hand  tools.  Thus,  a decision  was  made  to  include  a section  in  the 
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training  program  on  Test  Equipment  and  Tools.  Similarly,  inspection 
of  the  task  analysis  and  the  sample  JPA  indicated  that,  in  order  to 
follow  the  procedures  to  be  included  in  the  JPA,  trainees  would  have 
to  be  able  to: 

1.  Solder. 

2.  Locate,  remove,  and  install  prime  equipment  units  in  the 
aircraft  (0- level) ; and  on  the  test  bench  (I-level)  . 

3.  Disassemble  units;  e.g.,  remove  covers,  etc.,  preparatory 
to  following  the  JPA  procedures. 

4.  Set  up  the  test  bench  and  power  supply  bench,  preparatory 
to  checking  out  and  troubleshooting  units. 

5.  Repair  and  replace  connectors  and  wire. 

Thus,  plans  were  made  to  include  in  training,  lessons  responsive  to  the 
five  items  listed  above. 

Additional  training  content  was  derived  by  reference  to  the  overall 
objective  of  the  program — namely,  to  teach  trainees  to  use  JPA.  Plans' 
were  made  for  including  considerable  "hands-on"  practice  in  the  program, 
using  the  JPA  and  the  prime  equipment.  The  rationales  for  selecting  JPA 
for  inclusion  in  the  program  were  as  follows: 

1.  Checkouts  in  the  aircraft  and  on  the  test  bench  were 
included,  for  two  reasons: 

a.  Practicing  the  checkouts  would  provide  trainees  with 
an  opportunity  to  observe  what  the  system  would  "look 
like"  when  all  subsystems  were  operating  normally. 

b.  Without  proficiency  in  performing  the  checkouts,  it 
would  be  unlikely  that  trainees  would  become  pro- 
ficient in  performing  the  JPA  troubleshooting  pro- 
cedures . 

2.  Replacing  digital  readouts,  switch  and  connector  assemblies, 
and  the  CRT  assembly,  as  well  as  certain  routine  "housekeepin  " 
tasks  would  be  included,  because  the  procedures  were  short  an 
easily  followed  by  a novice.  The  intent  here  was  to  provide 
trainees  with  some  quick  and  easy  success  in  using  JPA,  and 
thus  to  (hopefully)  build  self-confidence  in  the  trainees,  as 
well  as  confidence  in  the  JPA. 

3.  Troubleshooting  practice  with  bugged  equipment  would  be  used 
because,  in  the  final  analysis,  this  was  what  the  technicians' 
jobs  were  about.  Two  kinds  of  practices  would  be  used — part- 
problem  practices  for  "getting  their  feet  wet,"  and  whole-probieQ 
practices,  which  would  be  Identical  in  all  essentials  to 
troubleshooting  as  it  would  be  performed  on  the  job. 
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4.  Alignments  and  adjustments  were  to  be  included  because  of  their 
extreme  difficulty.  Experience  on  earlier  JPA  projects,  ana 
the  experience  of  our  own  technicians  in  aligning  and  adjust- 
ing the  AQA-7  system  led  us  to  believe  that  if  trainees  could 
be  taught  to  perform  the  alignments  and  adjustments,  they  would 
be  just  as  proficient  as  most,  and  more  proficient  than  many, 
of  the  technicians  who  were  currently  maintaining  the  system. 

Additional  training  requirements  were  derived  on  the  basis  of  examin- 
ing the  context  in  which  the  maintenance  was  to  be  performed — namely,  the 
Navy.  All  trainees  would  eventually  be  required  to  do  routine  paper  work 
as  part  of  their  jobs,  and  to  know  how  to  acquire  parts,  route  equipment 
through  the  shop,  etc.  A decision  was  therefore  made  to  include  instruc- 
tion in  Navy  Maintenance  Procedures  in  the  program. 

Finally,  a lesson  was  to  be  included  entitled,  "Introduction  to 
Training  and  JPA."  While  this  was  to  be  primarily  an  orientation  lesson, 
it  would  also  include  instruction  on  how  to  access  and  use  information 
contained  in  the  JPA. 


Lesson  Specifications 

After  general  training  requirements  were  derived  as  described  above, 
a preliminary  list  of  lesson  titles  was  prepared.  The  list  that  evolved 
from  the  preliminary  one  is  shown  in  Table  A-l  below. 


Table  A-l 

LESSON  TITLES 

INTRODUCTION  TO  TRAINING  AND  JPA 


PRIME  EQUIPMENT 

Locate  Units  in  Aircraft 
Reference  Designations 
Remove  and  Install  Units 
Unit  Disassembly  (0-Level) 
Unit  Disassembly  (I-Level) , 
Navy  Maintenance  Procedures 
Navy  Maintenance  Procedures 
Test  Bench 
Power  Supply  Bench 
Checkout  in  Aircraft 
Checkouts  on  Test  Bench 
Part-Problem  Practices 
Part-Problem  Practices 
Whole-Problem  Practices 
Whole-Problem  Practices 


including  "Special  Replacements 
(0-Level) 

(I-Level) 


(0-Level) 

(I-Level) 

(0-Level) 

(I-Level) 
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Table  A-l 
(cont) 


TEST  EQUIPMENT  AND  TOOLS 

Multimeter  (Simpson  260) 

Digital  Voltmeter  (Fluke  8300A) 
Differential  Voltmeter  (Fluke  931B) 

Scope  (Tektronix  454) 

Hand  Tools 

SOLDERING 

REPAIRS  AND  REPLACEMENTS 

Connectors  and  Wire 

Digital  Readouts 

Switch  and  Connector  Assemblies 

CRT  Assembly 

ALIGNMENTS  AND  ADJUSTMENTS 

FMS  10Hz  Oscillator  (FMS  Coil) 

Spectrum  Analyzer-Quantizer  Subassemblies 

Demultiplexer 

DLC  Resolver 

FMS  Amplifier-Multiplier 
20  MHz  Amplifiers 
SDR  Power  Supplies 
3FI  Modules 

HOUSEKEEPING 

Air  Filters 
CRT  and  Heat  Sink 
SDR  Subassemblies 


Lesson  specifications  were  developed  for  each  of  the  lessons  shown 


in  Table 


Each  lesson  specification  contained  sections  on: 


1.  Overall  Goals 

2.  Task  Description  References 

3.  Performance  Outcomes 

4.  Performance  Assessment 

5.  Training  and  Testing  Materials 

6.  Minimal  Practice  Requirements 

7.  Instructional  Procedure 
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Overall  Goals.  This  section  of  each  lesson  specification  contained 
a global  statement  of  the  behavior  that  the  lesson  is  designed  to  elicit. 

It  was  a summary  of  entries  in  the  action  and  output  columns  of  the  Task/ 
Activity  Descriptions. 

Task/Activity  Description  References.  This  section  was  a list  of  the 
task  and  activity  codes  (from  the  Task/Accivity  Descriptions) . The  purpose 
of  the  section  was  to  show  which  job-tasks  and  activities  each  lesson 
specification  applies  to. 

Performance  Outcomes.  Entries  in  the  "Performance  Cutcomes"  sections 
of  the  lesson  specifications  were  brief  statements  of  the  kinds  of  behavior 
that  trainees  will  be  capable  of  demonstrating  at  the  end  of  the  lesson. 
Essentially,  these  entries  were  objectives  without:  (a)  statements  of  the 
conditions  under  which  the  behavior  is  to  be  demonstrated,  and  (b)  criteria 
for  acceptable  performance.  An  example  of  a performance  outcome  for  the 
Simpson  260  is,  "Connect  test  leads  to  meter." 

Performance  Assessment.  Whereas  that  "Performance  Outcomes"  sections 
of  the  lesson  specifications  were  to  indicate  the  kinds  of  behavior  that 
trainees  will  demonstrate  on  completion  of  the  lesson,  the  "Performance 
Assessment"  sections  specified  the  conditions  under  which  the  benavior  is 
expected  to  occur,  and  criteria  for  acceptable  performance.  The  general 
form  of  the  entries  in  the  "Performance  Assessment"  sections  were,  "Given 
...(training  and  testing  materials),  trainees  will. .. (statement  of  desired 
behavior),  to ... (criterion  of  mastery)."  In  essence,  the  "Performance 
Assessment"  sections  addressed  the  issue  of  how  one  might  reliably  dis- 
criminate between  trainees  who  had,  and  trainees  who  had  not,  mastered 
the  content  of  the  lesson. 

Together,  the  "Performance  Assessment"  and  "Performance  Outcomes" 
sections  comprised  what  are  usually  called  "behavioral  objectives."  The 
reason  for  separating  the  outcomes  (behavior)  from  the  conditions  and 
criteria  is  to  eliminate  the  step  of  "translating"  objectives  into  test 
items:  ultimately,  we  should  be  able  to  state  objectives  in  terms  of 

test  items. 

Training  and  Testing  Materials.  Most  of  the  entries  in  this  section 
of  the  specifications  were  derivable  from  the  "input"  and  "action"  columns 
of  the  Task/Activity  Descriptions.  These  entries  were  supplemented  with 
specifications  for  materials  that  would  be  needed  for  training  and  testing, 
but  not  necessarily  for  on-the-job  performance;  a VOM  trainer,  for  example, 
or  wall  charts  or  slides. 

Minimal  Practice  Requirements.  This  section  summarized  the  kinds  of 
practice  required  to  promote  efficient  learning  of  the  behavior  of  interest. 
Obviously,  one  cannot  specify  before  tryout  the  optimal  mix  of  practice 
that  will  ensure  learning.  Rather,  the  intent  was  to  specify  the  kinds 
of  practice  without  which  learning  the  desired  behavior  would  seem  unlikely. 
Examples  of  the  kinds  of  practice  referred  to  here  appear  in  a sample  lesson 
specification  attached  (Figure  A-14). 
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AQA-7  LESSON  SPECIFICATION 


LESSON  TITLE:  Tektronix  45 4 Oscilloscope 


I x 0 


PART  2 of  4:  Procedures 

OVERALL  GOALS: 

1.  According  to  a prescribed  sequence  of  operations: 

a.  Warm  up  the  scope. 

b.  Get  a trace  on  channel  1. 

c.  Center  and  focus  the  trace. 

d.  Get  square  waves. 

e.  Tune  the  probe. 

PERFORMANCE  OUTCCJES: 

1.  Using  job  aids  (3”  x 5"  cards,  listing  control 
settings) , perform  procedures  for  doing  items 
l.a.  through  i.e.,  above. 

(See  attachment  for  procedures.) 


PERFORMANCE  ASSESSMENT: 

1.  Conditions:  cover  on  scope,  scope  unplugged,  controls  "scrambled. 
Using  the  job  aids,  trainees  set  up  the  scope  and  perform  the 
five  procedures.  Instructor  uses  checklist  to  rate  the  following 
as  satisfactory  or  unsatisfactory. 

a.  Adherence  to  pre-plug  in  procedure. 

b.  Whether  or  not  trainee  gets  linear  trace. 

c.  Quality  of  centering  and  focusing. 

d.  Whether  or  not  trainee  gets  square  waves. 

e.  Flatness  of  square  waves  after  trainee  tunes  probe.. 

Repeat  procedure  with  remedial  instruction  to  100  percent 
mastery  with  probe  tuned  in  less  than  three  minutes. 


Figure  A-14.  Sample  Lesson  Specification 
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TRAININ G AND  TESTING  MATERIALS: 

!•  One,  preferably  two,  scopes  per  four  trainees. 

2.  Wall  chart  of  scope  front  panel. 

3.  Instructional  booklets  (one  per  trainee). 

4.  Job  aids,  similar  to  attached,  but  plastic  coated. 

SUPPORT  REQUIREMENTS: 

1.  Artwork  for  wall  charts  and  instructional  booklets. 

2.  Instructor  to  check  responses  and  monitor  testing. 

INSTRUCTIONAL  PROCEDURE:  (See  attached  chart) 

PREREQUISITES: 

1.  Lessons  on: 

a.  System  Introduction. 

b.  JPA  Orientation. 

c.  Oscilloscope:  Setup  and  Orientation. 

2.  This  lesson  is  a prerequisite  for: 

a.  Scope,  Parts  3 £.  4 JPA  Standard  Statements, 

o.  System  Checkout  (I-ievel). 

c.  Troubleshoot  Units. 

d.  Adjustments. 

MISCELLANEOUS  NOTES: 

1.  Include  "incidental"  instruction  on  use  of  trace  finder 
in  this  lesson. 

2.  Docs  this  scope  have  an  ASTIG  adjustment?  If  so,  include 
ASTIG  adjustment  if  focus  does  not  give  focused  display 
over  entire  trace  length. 


figure  A— 14.  Sample  Lesson  Specification 
(continued) 
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Figure  A- 14.  Sample  Lesson  Specification 
(cunt  i lined) 
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Instructional  Procedure.  This  section  of  each  lesson  specification 
described  (generally  at  first  and  more  specifically  later)  what  the  trainees 
and  instructor (s)  would  be  expected  to  do  during  each  lesson,  and  served  as 
a starting  point  for  designing  instructional  materials  and  procedures.  The 
"Instructional  Procedures"  sections  of  the  lesson  specifications  should 
reflect  adherence  to  principles  of  instructional  technology — self-pacing, 
the  use  of  job  aids,  instruction  at  the  "point  of  need,"  etc. 

As  the  project  progressed,  the  specification  contents  were  modified 
as  follows: 

1.  Task/Activity  Description  References  were  deleted.  These 
references  were  originally  included  to  make  sure  that  all 
lessons  would  have  referents  in  the  Task  Analysis  (Task/ 

Activity  Description).  Early  in  the  project  it  became 
obvious  that  this  was  indeed  the  case;  that  is,  all  of  the 
Lesson  Specifications  did  have  referents  in  the  Task 
Analysis.  Once  this  was  established,  there  was  no  need 
for  formally  identifying  the  task-analysis  source  for  the 
Lesson  Specifications. 

2.  The  Minimal  Practice  Requirements  sections  were  deleted, 
as  information  contained  therein  was  redundant  with 
information  in  the  Instructional  Procedure  section. 

3.  A Support  Requirements  section  was  added,  for  making  note 

of  special  materiel  and  personnel  required  for  administering 
the  lesson. 

4.  A standard  form  was  used  for  summarizing  the  instructional 
procedure. 


Lessons 


Lessons  were  prepared  for  each  of  the  titles  shown  in  Table  1.  The 
main  information  sources  used  in  developing  the  lessons  were  the  Lesson 
Specifications,  the  Task  Analysis,  and  the  JPA;  and,  for  the  test  equip- 
ment lessons,  users'  manuals.  In  cases  where  these  sources  proved 
inadequate,  technical  assistance  was  obtained  from  the  prime  equipment 
manufacturer's  representative  and  from  electronics  technicians  involved 
in  developing  the  JPA. 


Tryouts 


All  lessons  were  reviewed,  tried  out,  and  revised  on  the  basis  of  the 
trycut  results.  Reviewers  and  tryout  subjects  included  secretaries.  Navy 
recruits,  technicians  and  scientists,  Navy  instructors,  and  the  prime 
equipment  manufacturer's  representative. 
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Instructor  Lesson  Plans 


In  addition  to  the  Lesson  Specifications  and  Lessons,  an  Instrucco 
Lesson  Plan  was  prepared  for  each  lesson  shown  in  Table  1. 

Each  Lesson  Plan  contains  sections  entitled: 

1.  Overall  Goals:  a global  statement  of  the  lesson's 
obj  ectives . 

2.  Brief:  summary  descriptions  of  trainee  activities  during 
the  lesson. 

3.  Instructor  Activity:  descriptions  of  the  instructors' 
roles  in  administering  each  lesson. 

4.  Performance  Assessment:  instructions  for  assessing  trainees' 
mastery  of  lesson  contents,  and  for  providing  any  necessary 
remedial  instruction. 

The  instructor  Lesson  Plans  were  bound  in  a loose-leaf  book  which 
also  contained: 

1.  A section  entitled  "Note  to  the  Instructors."  This  section 
included : 

a.  A statement  of  the  purpose  of  the  training 
program. 

b.  Time  estimates  for  administering  each  lesson. 

c.  Sequencing  diagrams  for  the  lessons,  accompanied 
by  explanatory  text. 

a.  A section  entitled  "Using  the  Lesson  Plans,"  which 
emphasizes  that  instructors  should  read  the  Lesson 
Plans  and  take  each  lesson,  including  the  practice 
exercises  and  tests,  before  administering  the  pro- 
gram. 

2.  Performance  tests,  instructions  for  assessing  performance  for 
each  lesson,  or  both. 

3.  Printed  scripts  of  lessons  that  were  prepared  in  audiotape 
form. 

An  example  Instructor  Lesson  Plan  follows  (Figure  A- 15). 
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SCOPE  (TEKTRONIX  454) 


PART  1 


Set  Up  and  Orientation 


OVERALL  GOALS: 

1.  Set  up  the  scope  prior  to  warm  up. 

2.  Identify  major  sections  of  scope. 

3.  State  correspondence  between  knob  and  label  colors. 

4.  According  to  a prescribed  sequence  of  operations: 

a.  Warm  up  the  scope. 

b.  Get  a trace  on  Channel  1. 

c.  Center  and  focus  the  trace. 

d.  Get  square  waves. 

e.  Tune  the  probe. 


BRIEF: 

Trainee  will  read  lesson  guide  and  and  perform  the  procedures,  etc. 
given  in  the  lesson.  Trainee  may  seek  instructor's  aid  at  any  time. 
Trainee  will  set  up  scope  by:  1)  removing  the  front  cover  and,  2) 
positioning  the  nandle.  Trainee  will  identify  major  sections  of  the 
scope  by  labeling  on  a diagram  of  the  scope  front  panel  the  5 major 
sections  of  the  scope:  Power,  Calibration,  Vertical  Control,  Horizon- 
tal Control,  and  Presentation.  Trainee  will  demonstrate  by  filling  in 
blanks  in  lesson  guide  that  he  knows  that  red  labels  correspond  to  red 
knobs,  black  labels  to  grey  knobs.  Trainee  will  use  job  aid  "Procedure 
Cards"  to  perform  the  procedures  for  doing  items  4a  through  4’  in  the 
Goals  listed  above. 


Figure  A-15.  Example  Instructor  Lesson  Plan 
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INSTRUCTOR  ACTIVITY: 

Instructor  may  be  asked: 

1.  To  demonstrate  how  to  remove  cover  and  position  handle  at  the 
beginning  part  of  the  lesson. 

2.  How  to  set  LVS  to  match  line  voltage. 

3.  To  check  that  trace  gotten  at  end  of  Procedure  3 is 
satisfactory. 

A.  To  help  trainee  get  square  waves,  if  trainee  seeks  instructor’s 
aid. 

5.  lo  show  trainee  a 10  X probe  and  demonstrate  how  to  connect  it 
to  Input  Channel  1. 

6.  To  demonstrate  to  trainees,  the  proper  way  to  attach  the  probe 
tip  to  the  jack  labeled  IV  Cal  IK  Hz. 


7.  For  help  in  getting  square  waves. 

8.  To  demonstrate  how  to  use  the  adjusting  screw  in  the  3h'C  end 
of  the  probe  lead. 


PERFORMANCE  ASSESSMENT: 

Testing  will  be  done  as  part  of  performance  assessment  after  comple- 
tion of  Part  2 exercises. 


Conditions : cover  on  scope,  scope  unplugged,  controls  "scrambled." 

Using  the  job  aids,  trainees  set  up  the  scope  and  perform  the  five 
procedures . 


Observe  trainee  for: 

1.  Adherence  to  pre-plug- in  procedure. 

2.  Whether  or  not  trainee  gets  linear  trace. 

3.  Quality  of  centering  and  focusing. 

4.  Whether  or  not  trainee  gets  square  waves. 

5.  Flatness  of  square  waves  after  trainee  tunes  probe. 

Figure  A- 15.  Example  Instructor  Lesson  Plan 
(continued) 
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Repeat  procedure  with  remedial  instruction  to  100  percent  mastery 
with  probe  tuned  in  less  than  five  minutes. 


NOTE:  In  the  course  of  preparing  Job  Performance  Aids  for  the 

system  checkout,  we  found  that  the  efficiency  of  the 
checkout  in  the  aircraft  (O-Level)  could  be  greatly  in- 
creased by  use  of  an  Oscilloscope.  Unfortunately,  we 
discovered  this  too  late  to  revise  the  lesson  guides  to 
show  that  O-Level,  as  well  as  I-Level,  trainees  should 
receive  instruction  in  using  the  scope.  Instructors  should, 
therefore,  adjust  the  training  schedule  to  allow  O-Level 
trainees  to  take  the  scope  lesson.  The  lesson  can  be  taken 
any  time  before  the  Multimeter,  Locate  Units  in  Aircraft, 
Navy  Maintenance  Procedures,  Hand  Tools,  and  Reference 
Designations  Lessons. 


' 

I 

Figure  A-15.  Example  Instructor  Lesson  Plan 
(continued) 
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SCOPE  (TEKTRONIX  454) 


PART  2 


Exercises  in  Learning  Co  Make  Perceptual  Discriminations 
Between  Scope  Display  and  Exercise  Pictures 


OVERALL  GOALS: 

1.  Interpret  scope  displays  on  the  basis  of  practice  exercises. 

Trainee  learns  to  match  the  scope  display  to  picture  in  exercise. 


BRIEF: 

Trainee  will  read  lesson  guide  and  perform  the  procedures  given  in 
the  lesson.  Trainee  may  seek  instructor's  aid  at  any  time. 

Trainee  will  be  given  the  scope  control  settings,  will  connect  test 
leads,  make  necessary  adjustments,  and  match  display  to  the  or.e  shown 
in  the  exercise. 


INSTRUCTOR  ACTIVITY: 

Setups  for  Exercises 

All  three  Scope  Practice  Sets  must  be  hooked  into  the  Eico  wave 
generator  for  the  exercises  to  work.  It  doesn't  matter  whether 
three  trainees  have  a Practice  Set  in  use  or  not. 


Setting  up  the  Practice  Sets: 

1.  Connect  the  three  grey  wires  to  the  red  Sine  terminal  on 
the  Eico. 

2.  Connect  the  three  red  wires  to  the  red  square  terminal  on 
the  Eico. 

3.  Connect  the  three  purple  wires  to  the  black  terminal  on  the 
Eico . 

4.  Connect  the  other  end  of  each  grey  wire  to  the  white  terminal 
on  each  Practice  Set. 


Figure  A-15.  Example  Instructor  Lesson  Plan 
(continued) 
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5.  Connect  the  other  end  of  each  red  wire  to  the  red  terminal 
on  each  Practice  Set. 

6.  Connect  the  other  end  of  each  purple  wire  co  the  black 
terminal  on  each  Practice  Set. 

7.  Space  the  Practice  Sets  as  far  apart  as  possible. 


Eico  Adjustments 

Exercises  1-5:  Once  adjusted  for  Exercise  No.  1,  trainee  can  do 
the  first  exercises  without  further  adjustments. 

1.  Set  up  a scope. 

2.  Turn  power  ON  to  Eico  and  warm  up. 

3.  Set  Eico  Range  on  X10. 

4.  Set  large  round  dial  on  Eico  at  about  10. 

5.  Connect  scope  Input  (probe)  to  TP1  on  the  Practice  Set. 

6.  Ground  scope  to  GRND  on  Practice  Set. 

7.  On  the  scope: 

Set  VOLTS /DIV  Ch.  1 to  . 2 
Set  A and  3 TIKE/DIV  to  2ms 
Set  Input  Ch.  1 to  DC 
Set  A TRIGGERING  SLOPE  to  + 

8.  Adjust  the  Output  Level  Square  Waves  dial  on  the  Eico  to 
get  square  waves  that  measure  15  divisions  vertically. 

9.  Adjust  the  large  round  dial  on  the  Eico  until  each  square 
wave  measures  25  divisions  horizontally. 

10.  Remove  probe  and  ground  from  Practice  Set.  Scramble 
scope  settings. 


Exerciser,  (i- 9 : trainees  can  do  this  group  of  exercises  bv  ch.'.ngi 
the  Eico  range  to  X100.  If  there  is  a break  between  exercises,  d 
the  setup  as  above,  then  change  Eico  to  range  X100. 


Exercises  10—15:  Trainee  can  do  this  group  of  exercises  bv  chanp 
ing  the  Eico  range  to  XrK.  -if  there  is  a break  between  exercises 
do  the  setup  given  above,  then  change  the  Eico  range  to  X1K. 


Figure  A-15.  Example  Instructor  Lesson  Plan 
(continued) 
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Instructor  may  be  asked  for  help  at  any  time.  Some  possible  helps: 

1.  Demonstrate  how  to  connect  scope  ground  to  Practice  Set 
ground . 

2.  Help  in  making  position  adjustments. 

3.  Questions  concerning  explanation  of  graticule  and  use  of 
division  marks. 


Instructor  will  test  trainee  when  trainee  indicates  he  has  completed 
Parts  1 and  2. 


PERFORMANCE  ASSESSMENT: 


The 

tes 

t is 

in 

two 

parts,  one 

for 

and 

set 

the 

scope 

up,  and  one 

for 

the 

dis 

play 

to 

the 

illustration. 

ability  to  use  the  procedure  cards 
displaying  waveforms  and  matching 


Part  1 assessment:  See  conditions  and  description  in  Part  1 

Lesson  Plan. 


Part  2 assessment:  Set  up  Practice  Sets  and  Eico  as  for  the 

exercises  (see  Instructor  Activity) . Test 
requires  trainee  to  display  a waveform  and 
match  it  to  the  illustration. 

Any  remedial  instruction  will  consist  of:  1)  retaking  the  lesson  or 
parts  of  it,  or  2)  instructor  will  tutor  individual  trainee  concern- 
ing problem  area. 


Retraining  and  retesting  will  continue  until  the  trainee  can  success- 
fully pass  the  performance  assessments. 


NOTE:  In  the  course  of  preparing  Job  Performance  Aids  for  the 

system  checkout,  we  found  that  the  efficiency  of  the  checkout 
in  the  aircraft  (0-Level)  could  be  greatly  increased  by  use 
of  an  Oscilloscope.  Unfortunately,  we  discovered  this  too 
late  to  revise  the  lesson  guides  to  show  that  O-Levcl,  as  well 
as  I-Levcl,  trainees  should  receive  instruction  in  using  the 
scope.  Instructors  should,  therefore,  adjust  the  training 
schedule  to  allow  0-Level  trainees  to  take  the  scope  wesson. 
The  lesson  can  be  taken  any  time  before  the  Multimeter,  Locate 
Units  in  Aircraft,  Navy  Maintenance  Procedures,  Hand  Tools, 
and  Reference  Designations  Lessons. 


Figure  A-15. 


Example  Instructor  Lessor.  Plan 
(continued) 
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PERFORMANCE  TEST 

SCOPE  (TEKTRONIX  454) 

| 

TRAINEE:  

• Have  Instructor  set  up  EICO  and  Scope  Practice  Set  for  use. 

• Set  up  scope — use  Procedure  Cards  as  needed. 

• Make  setup  given  for  each  of  the  16  test  setups. 

• Find  each  displayed  waveform  and  write  the  test  setup  number  in 
the  blank. 


PART  1 


EICO  RANGE  should  be  set  on  X10.  DO  NOT  CHANGE  OTHER  SETTINGS 


Test  Setup  No. 

1.  TP  5 

VOLTS /DIV:  .2 

TIME/DIV:  1 ms 

2.  TP  2 

VOLTS/DIV:  .2 

TIME/DIV:  1 ms 


Test  Setup  No. 

4.  TP6 

VOLTS/DIV:  .2 

TIME/DIV:  2 ms 

5.  TP  3 

VOLTS/DIV:  .2 

TIME/DIV:  2 ms 


3.  TP  4 


6.  TP1 


VOLTS/DIV:  .2 

TIME/DIV:  1 ms 


VOLTS/DIV: 

TIME/DIV: 


Figure  A-15.  Example  Instructor  Lesson  Plan 
(continued) 


A6I 


NADC-78286-60 


PART  1 : WAVEFORMS 

Find  the  waveform  for  the  test  setup. 

Write  the  number  of  the  test  setup  in  the  space 


t 


Between  23  and  27 
j Divisions  I 


23  Divisions 
or  more 


hr. 


iv 

5 r 


Test  Setup  No. 


13  Divisions 
or  more 


|i 

L~ 


"est  Setup  No. 


Between 
15  and  22  jj 
Divisions  I: 


(At 

t’- . i 


Test  Setup  No. 


* 

— t. 


10  Divi-  le- 
sions or 
more 


Test  Setup  No. 


10  Divi~  |j| 
sions 
more 


4 

r 

— 

I. — ■ — . - — . . 

;l 

Figure  A-15.  Example  Instructor  Lesson  Plan 
(continued) 
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PART  2 


NADC-78286-60 

Change  EICO  RANGE  Co  X100.  DO  NOT  CHANGE  OTHER  SETTINGS. 


Test  Setup  No. 

7.  TP 4 10. 

VOLTS /DIV:  .2 

TIME/DIV:  .1  ms 

8.  TP 2 11. 

VOLTS /DIV:  .2 

TIME/DIV:  .1  ms 

9.  TP1 

VOLTS /DIV:  .2 

TIME/DIV:  .2  ma 


Test  Setup  No. 

TP  3 

VOLTS/DIV:  .2 

TIME/DIV:  .1  ms 

TP  3 

VOLTS/DIV:  .2 

TIME/DIV:  .1  ms 


Figure  A- 15.  Example  Instructor  Lesson  Plan 
(continued) 
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PART  2 : WAVEFORMS 


" 

* “ ' ‘V  ~r~  ’ | 

k ...  _ 

_J  ..... 

j\ -- 

- 

1. 

...  • .. 

! / 

i 

10  Divisions 

or  less 
Test  Setup  No. 


Less  than 

| ^ 3 Divisions 
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PART  3: 


Change  EICO  RANGE  to  X1K. 


DO  NOT  CHANGE  OTHER  SETTINGS. 


Test  Setup  Nr> . 

12.  TP 3 

VOLTS/OIV:  .2 

TIME/DI V:  10  us 


Test  Setup  No . 

15.  TP1 

VOLTS/DIV:  .2 

TIME/DIV:  20  us 


Test  Setup  Nn  . 


Test  Setup  No. 


16.  TP 5 


VOLTS/DIV:  .2 

TIME/DIV:  10  us 

| 


Test  Setup  Nn . 


14.  TP4 

VOLTS/DIV:  .2 

TIME/DIV:  10  us 


13.  TP2 

VOLTS/DIV:  .2 

TIME/DIV:  20  us 


l 


t 


Figure  A-15.  Example  Instructor  Lesson  Plan 
(continued) 
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APPENDIX  !).  ASSESSMENT  OE  A JOB  ORIENTED  TRAINING  PROGRAM  IN  SUPPORT 
OE  FULLY  PROCEDL  RALIZED  JOB  PERFORMANCE  AIDS 


By 

Lieutenant  Robert  P.  Fishbume,  Jr.,  MSC.  L'SNR 


Formerly  attached  to 
Navai  Technical  Training  Command 
Naval  Air  Station  Memphis  (75) 
Millington,  Tennessee  38054 
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SUMMARY 


I 

I 


« 


Forty-one  "A"  school  non-qualif ied  recruit  training  graduates  entered 
either  Organizational  ("0")  or  Intermediate  ("I”)  level  training  for  use 
of  Fully  Proceduralized  Job  Performance  Aids  (FPJPAs)  in  the  maintenance 
of  the  AN/AQA-7  Sonar  Recorder  Group  of  the  S2-G  aircraft.  The  thirteen 
week  "0"  level  and  sixteen  week  "I"  level  training  courses  resulted  in 
significant  learning  as  measured  by  unit  and  comprehensive  performance  tests. 
Additionally,  student  responses  to  an  attitudinal  questionnaire  were 
favorable  for  both  groups.  While  these  results  appear  to  be  positive,  no 
definitive  conclusions  can  be  drawn  until  corresponding  learning  data  is 
obtained  from  a control  group  under  the  traditional  training  pipeline  for  * 
the  AN/AQA-7  maintenance,  and  fleet  performance  data  is  obtained  on  both 
the  experimental  and  control  groups.  Problems  within  the  FPJPA  training 
system,  however,  have  been  identified  within  the  present  study. 
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In  January  1974,  che  Chief  of  Naval  Technical  Training  undertook  the 
task  of  evaluating  the  training  portion  of  the  NAVAIRDEVCEN' s integrated 
Job  Performance  Aids  (FPJPAs).  This  evaluation  involved  the  training  of 
15  graduates  of  recruit  training  who  were  destined  to  perform  organizational 
maintenance  ("0"  level)  of  the  AN/AQA-7  Sonar  Recorder  Group  (installed  in 
the  S-2G  aircraft),  and  26  graduates  of  recruit  training  who  would  receive 
training  to  the  intermediate  level  ("I"  level)  of  maintenance  of  this  same 
system.  The  "0"  level  training  required  approximately  thirteen  weeks,  and 
the  "I"  level  training  required  approximately  sixteen  weeks.  Of  the  entry 
personnel,  three  "0"  level  and  three  "I"  personnel  were  dismissed  from  the 
project  for  non-academic  reasons. 

As  the  subjects  were  selected  for  this  experimental  program  on  the  basis 
of  being  non-qualif ied  for  the  "A"  schools  (and  therefore  the  further 
advar.ceu  training  traditionally  required  for  maintenance  of  the  AN/AQA-7 
system) , the  rPJPA  training  course  and  maintenance  package  were  necessarily 
geared  to  this  unskilled  population. 

The  evaluation  task  was  to  provide  technical  monitoring  of  the  training 
environment,  appraisal  of  the  training  system  and  instructor  training 
preparation,  and  an  objective  analysis  of  training  effectiveness.  To  accom- 
plish these  objectives,  a quantitative  description  of  student  entry  behaviors 
was  compiled  as  a starting  point  in  developing  a comprehensive  appraisal  of 
the  training  system.  Table  B-i  presents  the  mean  Basic  Test  3attery  scores 
and  California  Reading  Test  scores  for  both  the  "0"  and  "I"  level  subjects. 

Of  particular  interest  are  the  "0"  and  "I"  level  GCT  scores  of  47.0  and  47.9 
respectively.  The  California  Reading  Test  scores  ("0"  level  = 10.4,  "I" 
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level  = 9.9)  are  probably  somewhat  inflated  due  to  that  test's  development 
and  validation  on  the  public  school,  rather  than  the  Navy  population.  While 
the  reading  grade  level  of  the  individuals  in  the  present  study  is  certainly 
a critical  factor  in  a system  dependent  upon  precisely  following  directions 
in  printed  materials,  its  impact  can  only  be  assessed  in  relation  to  the 
readability  of  the  FJPJAs.  Tables  B-2  and  B-3  oresent  the  readability  of  the 
FPJPA  training  materials  and  maintenance  manuals  as  determined  by  the 
Automated  Readability  Index  (ARI)  from  a ten  percent  sample. 

Table  B-l 

MEAN  BASIC  TEST  BATTERY  SCORES  AND  CALIFORNIA 
READING  TEST  SCORES  FOR  "0"  AND  "I"  LEVEL  CLASSES 


BASIC  TEST  BATTERY 

READINGj 
LEVEL  ' 

G A M C S E S 

C R E L 0 T H 

T I C E N S 0 

H R A T P 

R 

CA 

"0"  Level 

i 

X 

47.0  48.6  49.7  55.3  45.7  47.2  46.6 

10.4  ! 
1 

SD 

3.0  3.5  4.1  8.5  16.6  5.5  4.7 

! 

1.5  ! 

i 

i 

"I"  Level 

| 

X 

47.9  46.7  47.9  53.1  54.6  49.1  48.9 

9 9 ■ 
1 

SD 

2.9  4.0  3.9  7.8  9.4  7.4  5.8 

1.6  j 

A 


B4 


NADC-78286-60 

Table  B-2 


READABILITY  OF  FPJPA  TRAINING  MATERIALS 


COURSE  UNIT 


Multimeter 


GRADE  LEVEL 


Differential  Voltmeter 
Digital  Voltmeter 
Scope 

Unit  Disassembly 

Switch  & Connector  Assemblies 

Digital  Readouts 

CRT  Assemblies 


Introduction  to  JPAs 


Table  B-3 


READABILITY  OF  FPJPA  MAINTENANCE  MATERIALS 


ASA  FILE  NO. 

ARI  GRADE  LEVEL 

ASA  FILE  NO. 

ARI  GRADE  LEVEL 

33 

6.237 

46 

5.442 

51 

7.529 

47 

9.592 

38 

7.323 

48 

9.067 

55 

4.029 

29 

5.141 

14 

7.943 

21 

4.972 

18 

5.  199 

20 

4.261 

40B 

5.870 

24 

4.125 

4 1A 

8.493 

54 

9.323 

4 IB 

7. 190 

22 

3.903 

41C 

8.493 

17 

4.044 

4 ID 

8.493 

28 

5.776 

4 IE 

8.493 

43A 

8.342 

4 IF 

8.493 

43B 

8.914 

4 1G 

8.493 

13 

5.013 

4 1H 

8.317 

39A 

9.820 

44 

8.817 

393 

11.654 

1 *5 

4.516 
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The  ARI  grade  levels  of  the  training  course  units  appear  to  be  well  below 
the  California  Reading  Test  grade  levels  of  both  the  "0"  and  "I"  level 
students.  Likewise,  this  is  true  in  all  but  one  sample  of  the  FPJPA 
maintenance  materials . 

The  measurement  and  evaluation  of  training  course  effectiveness  result- 
ing from  the  present  study  has  been  designed  around  the  recording  of 
individual  performance  scores  on  each  JPA  unit  test  within  the  course  of 
study  and  on  the  final  comprehensive  JPA  performance  test.  The  final 
comprehensive  test  is  further  analyzed  in  terms  of  time  to  complete  each 
problem  and  a breakdown  of  critical  errors  within  these  problems.  Finally, 
this  data  is  augmented  by  a questionnaire  in  the  semantic  differential 
format  which  was  designed  to  elicit  the  opinions,  attitudes,  and  experiences 
of  both  the  instructors  and  students  of  the  "0"  and  "I"  level  JPA  classes. 
Additionally,  this  questionnaire  incorporates  a rating  scheme  concerning 
the  perceived  level  of  difficulty  of  each  training  course  unit. 

Table  B-4  presents  the  mean  "0"  level  performance  scores  on  those  JPA 
unit  tests  in  which  percentage  grading  was  compatible.  These  training  course 
units  are  as  follows:  Reference  Designations,  Unit  Disassembly,  Multimeter 
Progress,  Multimeter  Performance,  and  Scope.  The  lowest  mean  score  (77.21) 
in  this  series  appears  in  the  Multimeter  Performance  Unit. 
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Table  B-4 

MEAN  "0"  LEVEL  PERFORMANCE  SCORES  ON  JPA  UNIT  TESTS 
(Percent  Correct) 


Tables  B-5  and  B-6  present  the  mean  "I"  level  Class  A and  Class  B 
performance  scores  on  the  following  unit  tests:  Reference  Designations, 
Unit  Disassembly,  Multimeter  Performance,  Differential  Voltmeter,  Digital 
Voltmeter,  Test  Bench,  and  Scope.  Low  mean  scores  appear  only  on  Part  A 
of  the  Test  Bench  unit  test  in  Class  A (78.00)  and  on  Part  A of  the 
Multimeter  Progress  test  in  Class  B (70.00). 
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MEAN  "I"  LEVEL  (A)  PERFORMANCE  SCORES 
(Percent  Correct) 

ON  JPA 

UNIT  TESTS 

Reference 

1 

Designations 

Unit 

Multimeter 

Differential, 

Part  Part 

Disassembly 

Performance 

Voltmeter 

A B 

I 

i 

98.14  100.00 

100.00 

88. 16 

i 

91.21 

2.34 

8.29 

17.78  i 

. I 

Digital 

Test 

Bench 

i 

Scope  i 

Voltmeter 

Part  Part 

Part 

Part 

« 

A B 

C 

D 

93.85 

78.00  98.18 

100.00 

93.18  96.12 

7.68 


14.76 


6.03 


11.63 


10.82 
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Table  B-6 


MEAN  "I"  LEVEL  (B)  PERFORMANCE  SCORES  ON  JPA  UNIT  TESTS 
(Percent  Correct) 


Desi 
j Part 
! A 

I 

gnations 

Part 

B 

Unit 

Disassembly 

Multimeter  P 
Parc  Part 

A B 

rogress 

Part 

C 

| 

Multimeter 

Performance 

i 90.38 

100.00 

100.00 

70.00 

88.33 

90.00 

79.13 

24.62 

[ 

— 

— 

6.32 

11.69 

10.95 

11.48 

< ~ __  __  _ -i 

Differencial 

Voltmeter 

Part 

A 

Test 

Part 

B 

Bench 

Part 

C 

Part 

D 

I 

Scope  ' 

j 

1 

100.00 

100.00 

97.50 

100.00 

100.00 

1 

94.23  ' 

I 

— 

— 

7.70 

— 

— 

10.96 

B9 
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The  formal  evaluative  tryout  concerning  the  FPJPAs  was  started  after 
these  JOT  programs  were  completed.  A description  and  performance  data 
regarding  this  tryout  are  found  in  the  body  of  this  report.  In  addition  to 
the  task  success  and  time  data  found  in  Tables  1 and  2 of  the  body  of  the 
report,  the  following  "Critical  Error  Diagnoses"  were  made  to  identify  possible 
training  and  FPJPA  deficiencies.  A "critical  error"  as  defined  here  is  an 
incorrect  response  or  deviation  from  the  correct  FPJPA  maintenance  path 
causing  failure  of  a problem  trial  by  two  or  more  subjects.  Tables  B-7 
and  B-8  present  the  critical  error  analysis  for  the  "0"  and  "I"  levels 
respectively.  Within  the  "0"  level  problems,  the  most  frequent  critical 
errors  occurred  in  steps  498  - 499  (tasks  «=  set  sv'itch,  check  waveform) 
and  257  - 258  (task  = check  indications)  of  problem  1A1,  step  278  and 
5845  (tasks  = depress  tile  and  discriminate,  check  traces)  of  problem 
4A2,  and  step  278  (task  = depress  tile  and  discriminate)  of  problem  FMS//2. 

For  the  "I"  level,  the  most  frequent  critical  errors  occurred  in  steps  7 
and  39  (tasks  = check  indication  (DVM) , check  waveform)  of  problem  6A4, 
steps  16-20  (tasks  = set  switch,  adjust  (delaytime  multiplier),  adjust  (R9) 
of  problem  4A2 , and  steps  23-26  (tasks  * set  switch,  adjust  (OVV  SIG))  of 
problem  11A3. 


BIO 


Step 

Problem  Number 
1A1  248 

498 

499 

25V 

258 


f 


259 

4A2  258 

259 

278 
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Table  B-7 

* « •• 

CRITICAL  ERROR  ANALYSIS  FOR  ALL  "0"  LEVEL  Ss 


Task 


X Ss 
Making 
Critical 

JPA  Passage  . Error 


Check  printouts  (SDR)  Check  that  SDR  printouts  . 18.2 

are  similar  to  (10).  If 
not,  go  to  step  3102. 


Set  switch  Set  VOLTS/DIV  switch  to  .5.  45.5 

Set  TIME/DIV  switch  to  . 1 ms . 

Set  TRIGGERING  SOURCE  to  INT. 


Check  waveform 


Check  indications 


Check  indications 


Check  that  displayed  waveform 
is  similar  to  (10).  If  not, 
go  to  step  508. 

200  seconds  between  257  and  45.5 
261  degrees.  300  seconds 
between  259  and  260  degrees. 

Check  that  recorded  indica- 
tions and  listed  indications 
of  step  255  through  step  257 
agree.  If  not,  repeat  step 
253  through  257  once.  If 
indications  do  not  agree  the 
second  time,  go  to  step  3141. 


Check  printouts  (SDR)  Check  that  SDR  printouts  are 

similar  to  (14).  If  not,  go 
to  step  3203. 


Check  indications  Check  that  recorded  indica-  16.7 

tions  and  listed  indications 
of  step  255  through  step  257 
agree.  If  not,  repeat  step 
253  through  257  once.  If 
indications  do  not  agree  the 
second  time,  go  to  step  3141. 

Check  printouts  (SDR)  Check  that  SDR  printouts  are 

similar  to  (14).  If  not,  go 
to  step  3203. 


Depress  tile  and 
discriminate 


Alternately  depress  MOVE  83.3 

RIGHT  tile  (17)  and  MOVE 
LEFT  tile  (18)  until  BFI 
display  is  similar  to  (33). 

If  unable  to  obtain  display, 
go  to  step  5845. 


i 
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2 Fs 


Step 

Problem  Number  Task 
t 4A2  5845  Check  Traces 

I 

19A2  234  Check  display  (3FI) 


5025  Check  waveform 


5028  Check  display 


5035  Check  display  (BFI) 


. FMS//2  278  Depress  tile  and 

discriminate 

■ 


5845  Check  Traces 


5895  Check  Trace 


20A1  1021  Check  indication 

(multimeter) 


* Critical  Error  ■ Significant  error  or 
path  causing  failure 


Making 
.Critical 

JPA  Passage  Error 

Check  that  Traces  A,  B, 

C,  and  D are  not  similar 
to  (1).  If  any  are  similar, 
go  to  step  5845. 

Check  that  BFT.  display  is  33.3 

similar  to  (5).  If  not,  go 
to  step  5023. 

Check  that  displayed  wave-  25.0 

form  is  the  same  as  (1).  If 
not,  replace  SIGNAL  DATA 
RECORDER  RO-396  (10);  go 
to  step  1. 

Check  that  BFI  display  is  16.7 

similar  to  (9).  If  not, 
go  to  step  5037. 

Check  that  BFI  display  is  25.0 

similar  to  (9).  If  not, 
go  to  step  5045. 

Alternately  depress  MOVE  90.0 

RIGHT  tile  (17)  and  MOVE 
LEFT  tile  (18)  until  BFI 
display  is  similar  to  (33). 

If  unable  to  obtain  display, 
go  to  step  5845. 

Check  that  Traces  A,  B, 

C,  and  D are  not  similar  to 
(1).  If  any  are  similar,  go 
to  step  5845. 

Check  that  Trace  C is  20.0 

similar  to  (8).  If  not, 
go  to  step  5908. 

Check  that  multimeter  16.7 

indicates  between  110 
VAC  and  120  VAC.  If  not, 
go  to  step  1229. 

deviation  from  correct  JPA  maintenance 
of  a problem  trial  by  two  or  more  Ss . 


NADC-78286-60 

Table  B-8 


CRITICAL  ERROR  ANALYSIS  FOR  ALL  "I"  LEVEL  Ss 


Problem 

Step 

Number 

1 

Task 

JPA  Pass ace 

% Ss 
Making 
Critical 
Error 

PPG 306 

22 

Check  indicator 
(115  VAC) 

Check  that  115  VAC  indi- 
cator (3)  is  not  lit.  If 
lit,  go  to  step  730. 

9.0 

733 

Check  indicator 
(115  VAC) 

Check  that  115  VAC  indi- 
cator (3)  is  not  lit.  Tf 
lit,  go  to  step  735. 

13.6 

6A4 

7 

Check  indication 
(DVM) 

Check  that  DVM  indicates 
between  7.9M  and  8. 1M  ohms. 

If  not,  go  to  step  72. 

21.7 

9 

Check  indication 
(DVM) 

\ 

Check  that  DVM  indicates 

50  K ohms  or  more.  If  not, 
replace  6A4A1C22  (22)  ; go 
to  step  1. 

8.7 

39 

Check  waveform 

Check  that  displayed  wave- 
form is  similar  to  (8). 

If  not,  go  to  step  139. 

21.7 

139 

Adjust  (6A4  Video 
Amplifier) 

Perform  6A4  Video  Amplifier; 
adjust  (Vol . NADC-CSM- 74010, 

P-  5-1). 

140 

Check  adjustment 

Check  that  adjustment  was 
successful.  If  not,  go  to 
step  142. 

4A2 

9 

Adjust  (R4) 

Adjust  R4  (11)  until  dis- 
played waveform  is  similar 
to  (10). 

13.0 

16 

Connect  (scope)  » 

4 

Using  Tektronix  454,  connect 
input  to  A2J11  (3).  Connect 
probe  ground  to  A2 J 1 (4). 
Connect  EXT  TRIG  INPUT  to 
A1J11  (5). 

56.5 

17 

Set  switch 

Set  VOLTS/DIV  switch  to  .2. 
Set  TIME/DIV  switch  to  20  mS. 
Set  TRIGGERING  SOURCE  to  EXT. 

* Critical  Error 

r 

* Significant  error  or 
path  causing  failure 

deviation  from  correct  JPA  maintenance 
of  a problem  trial  by  two  or  more  Ss. 

l 

HI  3 


NADC-78286-60 


Problem 

Step 

Number 

Task 

JPA  Passage 

% Ss 

. 9 

Making 

Critical 

Error 

4A2 

18 

Set  switch  ' ' , 

Set  HORIZ  DISPLAY  switch 
to  A INTER  DURING  B.  Set 
DELAYED  SWEEP  control  to 

2 mS.  Set  B SWEEP  MODE 
switch  to  B - STARTS  AFTER 
DELAYTIME.  Set  A SWEEP  MODE 
switch  to  NORM  TRIG. 

19 

Adjust  (Del ay time 
multiplier) 

Adjust  DELAYTIME  MULTIPLIER 
control  until  brightened 
portion  of  sweep  is  centered 
over  pulse  (6). 

20 

Set  switch 

Set  HORIZ  DISPLAY  switch  to 

B (DELAY ED/ SWEEP ) . 

22 

Adjust  (R9) 

Adjust  R9  (9)  until  pulse 
(14)  reaches  maximum  nega- 
tive peak. 

8.7 

1 1A3 

23 

Set  switch 

Set  DVM  SELECT  switch  (15) 
to  11A3  S1G. 

23.8 

24 

Set  switch 

Set  1 1A3  TEST  switch  (1)  to 
31V. 

25 

Adjust  (OVV  SIC.) 

Adjust  OW  SIG  ADJUST  11A3 
(2)  until  DVM  indicates  0 

VDC. 

26 

Set  switch  (DVM 

Select) 

Set  DVM  SELECT  switch  (3)  to 

1 1A3  OV  CUR. 

* Critical  Error 

= Significant  error  or 
path  causing  failure 

deviation  from  correct  JPA  maintenance 
of  a problem  trial  by  two  or  more  Ss . 

BI4 

• 

. 

-»  . - • — • 
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Student  responses  to  the  JPA  Training  Course  Questionnaire  are  presented 
in  Appendices  B-A  and  B-B.  "0!1  and  "I"  level  responses  in  general  indicated 
the  following: 

- Student  like  the  overall  JPA  Training  Course  a lot 

- Students  felt  they  learned  a lot  from  the  JPA  Training  Course 

- Students  found  the  written  materials  easy  to  understand 

- Students  found  the  JPA  pictures  to  be  relatively  easy  to  follow 

- Students  needed  the  instructor  to  explain  the  written  instructions  a 
few  times 

- Students  found  that  some  of  the  training  material  was  wrong  more  than 
a few  times  for  the  "0"  level  and  often  for  the  "I"  level 

- Students  neither  liked  nor  disliked  not  getting  any  theory  in  the 
course 

- Students  like  a lot  the  idea  of  using  JPA  books  for  all  maintenance 
task  work 

- Students  felt  that  the  right  amount  of  time  was  spent  on  each  part 
of  the  course 

- Students  think  this  course  will  help  them  advance  in  rate  but  many 
are  unsure,  especially  in  the  "I"  level 

- Students  like  a lot  the  following  of  JPA  directions  instead  of  making 
maintenance  decisions  at  the  "0"  level  and  a little  at  the  "I"  level 

- Students  indicated  that  this  JPA  Training  Course  helped  a lot  in 
learning  to  follow  JPA  direction 

- Students  indicated  that  the  JPA  training  materials  did  not  seem  to 
get  harder  toward  the  end  of  the  course 

- Students  indicated  that  equipment  problems  kept  them  from  working  a 
little  of  the  time 

- Students  indicated  that  the  organization  of  the  JPA  training  course 
was  O.K. 

- Students  indicated  that  their  instructor  was  very  helpful  in  the  "0" 
level  and  more  than  helpful  at  the  "I"  level 


BIS 
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- Students  felt  that  the  right  amount  of  time  was  spent  on  working  with 
the  actual  equipment  rather  than  studying  books 

- Students  would  recommend  JPA  training  for  all  basic  electronics 
maintenance  courses 

- Students  are  not  sure  whether  they  plan  to  make  a career  in  the  Navy 

- Students  feel  that  this  JPA  Training  Course  will  help  them  to  be  a 
useful  part  of  the  Navy  maintenance  team 
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Tables  B-9  and  B-10  present  the  "0"  and  "I"  level  student's  rating  of 
the  difficulty  of  the  JPA  Training  Course  Units.  At  the  "0"  level,  only 
one  course  unit,  "Multimeter,"  was  rated  as  being  hard  by  more  than  ten 
percent  of  the  respondents.  At  the  "I"  level.  However,  eleven  course  units 
were  rated  as  being  hard  by  more  than  ten  percent  of  the  respondents.  They 
are  as  follows:  "Miniature  Repair,"  "Multimeter,"  "Differential  Voltmeter," 
"Navy  Maintenance  Procedures,"  "SDR  Sub-assemblies,"  "CRT  and  Heat  Sink," 
"Connectors  and  Wires,"  "Part-Problem  Practices,"  "Alignments  and  Adjustments, 
"Digital  Readouts,"  and  "CRT  Assembly." 

Table  B-9 

"0"  LEVEL  STUDENTS'  RATING  OF  TRAINING  COURSE  UNITS 


(Mean  Percentage 

Per  Category) 

' 

Course  Unit 

Very 

Very 

Easy 

Easv 

Hard 

Hard 

Introduction  to  Training  and  JPA 

55 

36 

9 

0 

Multimeter 

9 

64 

27 

0 

Locate  Units  in  Aircraft 

73 

27 

0 

0 

Navy  Maintenance  Procedures 

18 

82 

0 

0 

Hand  Tools 

27 

73 

0 

0 

Reference  Designations 

45 

45 

9 

0 

Remove  and  Install  Units 

Air  Filters 

91 

9 

0 

0 

Unit  Disassembly 

55 

45 

0 

0 

Connectors  and  Wires 

18 

73 

9 

0 

Checkout  In  Aircraft 

36 

64 

0 

0 

Switch  and  Connector  Assemblies 

55 

45 

0 

0 

Digital  Readouts 

45 

45 

9 

0 

Part  - Problem  Practices 

27 

64 

9 

0 

Whole  Problem  Practices 

27 

64 

9 

0 
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' ' Table  B-10 

"I"  LEVEL  STUDENTS'  RATING  OF  TRAINING  COURSE  UNITS 
(Mean  Percentage  Per  -Category) 


Course  Unit 

Introduction  to  Training  and  JPA 
Miniature  Repair  (Soldering) 
Multimeter 

Differential  Voltmeter 
Digital  Voltmeter 
Scope 

Hand  Tools 

Reference  Designations 

Navy  Maintenance  Procedures 

Unit  Disassembly 

Test  Bench 

Air  Filters 

SDR  Sub-assemblies 

CRT  and  Heat  Sink 

Connectors  and  Wires 

Checkouts  on  Test  Bench 

Power  Supply  Bench 

Part  - Problem  Practices 

Alignments  and  Adjustments 

Digital  Readouts 

Switch  and  Connector  Assemblies 

CRT  Assembly 


Very 

Easy 

Easy 

Hard 

Very 

Hard 

48 

52 

0 

0 

17 

9 

52 

22 

13 

74 

13 

0 

13 

65 

22 

0 

48 

43 

9 

0 

13 

78 

9 

0 

64 

32 

4 

0- 

26 

61 

9 

4 

9 

64 

27 

0 

45 

50 

5 

0 

26 

65 

9 

0 

86 

14 

0 

0 

13 

70 

17 

0 

24 

52 

24 

0 

26 

57 

17 

0 

19 

75 

6 

0 

9 

82 

9 

0 

10 

75 

15 

0 

22 

65 

13 

0 

31 

52 

13 

4 

27 

68 

5 

0 

9 

68 

23 

0 

19 

76 

.5 

0 

Whole  Problem  Practices 
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Individual  responses  of  each  instructor  to  the  JPA  Training  Course 
Questionnaire  are  provided  for  comparative  purposes  in  Tables  B-ll,  B-12  and 
B-13.  The  "0"  level  instructor  rated  "Whole  Problem  Practices,"  only  as 
being  hard.  "I"  level  instructor  (A)  rated  "Multimeter,"  "Scope,"  "Checkouts 
on  Test  Bench,"  "Power  Supply  Bench,"  and  "Alignments  and  Adjustments"  as 
being  hard,  while  "I"  level  instructor  (B)  only  rated  "Whole  Problem  Practices" 
as  hard. 

Table  B-ll 

"0"  LEVEL  INSTRUCTOR'S  RATING  OF  TRAINING  COURSE  UNITS 


j Multimeter  Locate  Units  in  Whole  Problem 

I Aircraft  Practices 

j 

I Hand  Tools  Checkout  in  Aircraft 


Reference  Designations 

Remove  and  Install 
Units 

Air  Filters 
Unit  Disassembly 
Digital  Readouts 
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Table  B-12 


Very  Easy 

Easy 

Hard 

Very  Hard 

Introduction  to  Train- 
' ing  and  JPA 

Differential  Voltmeter 

Multimeter 

Miniature  Rep.: 

Digital  Voltmeter 

1 

SDR  Sub-assemblies 

Scope 

Navy  Maintcnanc 
Procedures 

i Hand  Tools 
l 

Reference  Designations 

i 

i 

CRT  and  Heat  Sink 

Checkouts  on  Test 

Bench 

! Unit  Disassembly 

Test  Bench 

Connectors  and  Wires 

Power  Supply  Bench 

| Air  Filters 

| 

Alignments  and  Adjust- 
ments 

j Digital  Readouts 

i 

j Switch  and  Connector 
Assemblies 

CRT  Assembly 

Not  Available 

Part-Problem  Practices 

Whole  Problem  Practices 
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Table  B-13 

fc 

"I"  LEVEL  INSTRUCTOR  (B)'s  RATING  OF  TRAINING  COURSE  UNITS 


i 

; Very  Easy 

Easy 

Hard 

Very  Hard 

j Introduction  to  Train- 
■ ir.g  and  JPA 

Multimeter 

Whole  Problem 
Practices 

Miniature  Repai 

Digital  Voltmeter 

! 

Differential  Voltmeter 

Navy  Maintcnanc 
Procedures 

: Hand  Tools 

1 

Scope 

Reference  Designations 

Unit  Disassembly 

) 

, Air  Filters 

Test  Bench 

Digital  Readouts 

SDR  Sub-assemblies 

Switch  and  Connector 
Assemblies 

CRT  and  Heat  Sink 

j 

Checkouts  on  Test 

Bench 

i 

Alignments  and  Adjust- 
ments 

CRT  Assembly 

l 


Not  Available 


Part-Problem  Practices  Connectors  and  Wire 


I 
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observations  and  conclusions 

The  present  evaluation  has  necessarily  centered  upon  a quantitative 
description  of  the  "0"  ar.d  "I"  level  JPA  training  course  performances  and 
attitudes  of  a sample  of  medium  mental  group,  "A"  school  non-qualified 
personnel.  While  the  resulting  data  is  of  value  in  terms  of  criterion 
performance  assessment  and  within-course  problem  identification,  the  absence 
of  a control  group  prevents  a further  comparative  analysis  at  this  time. 
Accordingly,  the  following  observations  have  emerged: 

(1)  The  mean  GCT  + ARI  + MECH  Basic  Test  Battery  Combination  for  the 
"0"  and  "I"  level  sample  places  these  individuals  in  the  Mental  Group  IIIB 
category. 

(2)  The  readability  of  the  JPA  training  materials  and  maintenance  manuals 
appears  to  be  well  below  that  which  is  required  for  the  present  sample. 

(3)  JPA  Unit  Test  means  (percentage  correct)  indicate  satisfactory 
learning  (S5  percent  and  above)  for  all  "0"  level  units  except  the  Multimeter 
Performance  Unit  (77.21  percent)  and  all  "I"  level  units  except  the  Test 
Bench  Unit  (78.00  percent  on  Part  A),  the  Multimeter  Performance  Unit 
(79.13  percent),  and  the  Multimeter  Progress  Unit  (70.00  percent  on  Part  A). 

(4)  JPA  Comprehensive  Test  means  (percentage  completed)  indicate 
significant  learning  (90  percent  and  above)  for  all  "0"  level  problems  except 
the  4A1  (57.5  percent).  "I"  level  performance  means  are  significantly 
lower  with  three  problems  scoring  below  90  percent  (6A4  = 88.4%,  4A2  = 68.2%, 
11 A3  = 79.6%). 

NOTE:  (While  significant  learning  has  been  demonstrated  within  the  "0" 

level  problem  solving  and  to  a lesser  extent  within  the  "I" 


level 
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(10)  "0"  level  students  and  their  instructor  rated  only  one  course  unit 
as  being  hard,  while  a number  of  "I"  level  students  identified  nearly  half 
of  their  course  units  as  such.  "I"  level  instructors,  however,  rated  only 
from  one  to  four  course  units  as  hard. 

(11)  The  JPA  Training  Course  effectiveness  and  efficiency  may  have  been 
significantly  reduced  due  to  delays  in  curriculum  delivery,  errors  in 
curricuiuts  materials,  inadequate  testing  instruments,  lack  of  instructor 
training  on  JFA  technology  and  a shortage  of  test  equipment. 

(12)  The  JPA  training  course  required  13  weeks  for  the  "0"  level  and  16 

« 

weeks  for  the  "I"  level.  The  standard  pipeline  for  maintenance  of  the 
AN-AQA-7  requires  approximately  22  weeks  of  training  for  qualification  in 
the  AX  rating,  followed  by  two  weeks  of  "0"  level  and  14  weeks  of  "I"  level 
training  in  the  NAMTRADET.  Thus,  the  JPA  Training  Course  time  and  costs 
are  significantly  lower  than  that  of  the  "A"  and  "C"  school  graduate  who 
normally  performs  the  same  functions. 

(13)  A more  comprehensive  evaluation  of  the  JPA  training  technology  as 
employed  in  the  present  study  will  require  performance  test  data  from  a 
control  group  of  students  graduating  from  the  traditional  training  pipeline 
and  an  analysis  of  job  performance  feedback. 
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Appendix  B-A 

t "0"  LEVEL  STUDENT  RESPONSES  TO  JPA  TRAINING  COURSE  QUESTIONNAIRE 

I 

$ of  % of 


Ou 

estiennaire  Item 

Res 

ponse  Alternatives 

Responden  ts 
Per  Category 

Responds 
Per  Cat  a n 

1. 

Hov/  do  you  feel  about  the 

A. 

Liked  a lot 

8 

73 

overall  JPA  Training 

B. 

Liked  a little 

3 

27 

Course? 

C. 

Neither  liked  nor  disliked 

0 

0 

D. 

Disliked  a lot 

0 

0 

2. 

How  much  do  feel  you 

A. 

A lot 

10 

91 

learned  from  the  JPA 

B. 

A little 

1 

9 

Training  Course? 

C. 

Hardly  anything 

0 

0 

D. 

Nothing  at  all 

0 

0 

3. 

Hew  difficult  were  the 

A. 

Very  easy 

2 

18 

written  materials  for 

B. 

Easy 

7 

64 

you  to  understand? 

C. 

Neither  easy  nor  hard 

1 

9 

D. 

A little  hard 

1 

9 

E. 

Very  hard 

0 

0 

4. 

How  difficult  to  follow 

A. 

Very  easy 

3 

27 

were  the  JPA  pictures? 

B. 

Easy 

4 

37 

C. 

Neither  easy  ner  hard 

3 

O 1 

D. 

A little  hard 

L 

9 

E. 

Very  hard 

0 

0 

5. 

How  often  did  you  need 

A. 

Very  often 

0 

0 

the  instructor  to  explain 

B. 

Of  ten 

1 

9 

the  written  instructions? 

C. 

A few  times 

10 

91 

D. 

Never 

0 

0 

6. 

How  often  did  you  find 

A. 

Very  often 

0 

0 

that  some  of  your  train- 

B. 

Often 

4 

37 

ing  material  was  wrong? 

C. 

A few  times 

7 

63 

D. 

Never 

0 

0 

7. 

How  did  you  feel  about  not 

A. 

• Like  a lot 

1 

9 

getting  any  theory  in  this 

B. 

Like  a little 

1 

9 

course? 

C. 

Neither  like  nor  dislike 

8 

73 

D. 

Dislike  a little 

1 

9 

E. 

Dislike  a lot 

• 

0 

0 

8. 

How  do  you  feel  about 

A. 

Like  a lot 

9 

82 

using  JPA  books  for  all 

B. 

Like  a little 

1 

9 

your  maintenance  task 

C. 

Neither  like  nor  dislike 

1 

9 

work? 

D. 

Dislike  a little 

0 

0 

E. 

Dislike  a lot 

0 

0 

/ 


B25 


V to 
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V 

Questionnaire  Item 

ResDonse  Alternatives 

fl  of 

Respondents 
Per  Category 

% of 

Respondent 
Per  Cate go 

9. 

t 

How  did  you  feel  about 

A.  ■ 

Too  much  time 

1 

9 

the  time  spent  on  each 

B. 

Right  amount  of  time 

9 

82 

part  of  the  course? 

C. 

Not  enough  time 

1 

9 

10. 

Do  you  think  this  course 

A. 

Yes 

6 

55 

will  help  you  to  advance 

B. 

Not  sure 

4 

36 

in  rate? 

C. 

No 

1 

9 

11. 

How  do  you  feel  about 

A. 

Like  a lot 

8 • 

73 

following  JPA  directions 

B. 

Like  a little 

1 

9 

instead  of  making  your 

C. 

Neither  like  nor  dislike 

2 

18 

own  maintenance  decisions? 

D. 

Dislike  a little 

0 

0 

E. 

Dislike  a lot 

0 

0 

12. 

How  much  did  this  JPA 

A. 

A lot 

10 

91 

Training  Course  help  you 

B. 

A little 

1 

9 

to  learn  to  follow  JPA 

C. 

Hardly  any 

0 

0 

directions? 

D. 

Not  at  all 

0 

0 

13. 

Did  the  JPA  training 

A. 

Yes 

2 

18 

materials  seem  to  get 

B. 

No 

9 

82 

harder  toward  the  end  of 

the  course? 

14. 

How  often  did  equipment 

A. 

A lot 

1 

o 

problems  keep  you  from 

B. 

A little 

7 

64 

working? 

C. 

Hardly  ever 

3 

27 

D. 

Never 

0 

0 

15. 

How  well  did  the. JPA 

A. 

Very  well 

2 

18 

Training  Course  seem 

B. 

O.K. 

7 

64 

to  be  organized? 

C. 

Poorly 

2 

IS 

16. 

How  helpful  was  your 

A. 

Very  helpful 

11 

100 

instructor  to  you? 

B. 

Helpful 

0 

0 

C. 

Not  helpful 

0 

0 

17. 

How  do  you  feel  about 

A. 

Too  much  time 

1 

9 

the  amount  of  time 

B. 

Right  amount  of  time 

10 

91 

spent  on  working  with 

C. 

Not  enough  time 

0 

0 

the  actual  equipment 


rather  than  studying 
books? 


Would  you  recommend  JPA 

A. 

Yes 

8 

73 

training  for  all  basic 

B. 

Not  sure 

3 

27 

electronics  maintenance 
courses? 

C. 

No 

0 

0 
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Appendix  B-b 

1 1"  LEVEL  STUDENT  RESPONSES  TO  JPA  TRAINING  COURSE  QUESTIONNAIRE 


Questionnaire  Item 


Response'  Alternatives 


//  of 

Respondents 
Per  Category 


% of 

Responder, 
’er  Categn 


1. 

How  do  you  feel  about  the 

A. 

Liked  a lot 

16 

70 

overall  JPA  Training  Course? 

B. 

Liked  a little 

3 

13 

C. 

Neither  liked  nor 

disliked 

2 

9 

D. 

Disliked  a little 

1 

4 

E. 

Disliked  a lot 

1 

4 

2 _ 

How  much  do  you  feel  you 

A. 

A lot 

18 

78 

learned  from  the  JPA 

B. 

A little 

4 

13 

Training  Course? 

r' 

^ . 

Hardly  anything 

1 

4 

D. 

Nothing  at  all 

0 

0 

3. 

How  difficult  were  the 

A. 

Very  easy 

4 

17 

written  materials  for 

B. 

Easy 

10 

44 

you  to  understand? 

C . 

Neither  easy  nor 

hard 

6 

?b 

D. 

A little  hard 

3 

13 

E. 

Very  hard 

0 

0 

4 . 

How  difficult  to  follow 

A. 

Very  easy 

5 

22 

were  the  JPA  pictures? 

B. 

Easy 

15 

65 

C. 

Neither  easy  nor 

hard 

2 

9 

D. 

A little  hard 

1 

4 

E. 

Very  hard 

0 

0 

5 . 

How  often  did  you  need  the 

A. 

Very  often 

1 

4 

instructor  to  explain  the 

B. 

Often 

4 

1 b 

written  instructions? 

C. 

A few  times 

18 

78 

D. 

Never 

0 

0 

6. 

How  often  did  you  find 

A. 

Very  often 

7 

32 

that  some  of  your  train- 

B. 

Often 

1 1 

50 

ing  material  was  wrong? 

C. 

A few  times 

4 

18 

D. 

Never 

0 

0 

7. 

How  did  you  feel  about  not 

A. 

Like  a lot 

3 

13 

getting  any  theory  in  this 

B. 

Like  a little 

2 

9 

course? 

C.. 

Neither  like  nor 

dislike 

5 

22 

D. 

Dislike  a little 

7 

30 

E. 

Dislike  a lot 

6 

26 

8. 

How  do  you  feel  about  using 

A. 

Like  a lot 

11 

47 

JPA  books  for  all  your 

B. 

Like  a little 

5 

22 

maintenance  task  work? 

C. 

Neither  like  nor 

dislike 

2. 

9 

D. 

Dislike  a little 

5 

22 

E. 

Dislike  a lot 

0 

0 
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//  of 

Z of 

Respondents 

Rcsponden 

Questionnaire  Item 

Response  Alternatives 

Per  Category 

Per  Catego 

9. 

» 

How  did  you  feel  about 

A.' 

Too  .much  time 

1 

i 

4 

the  time  spent  on  each 

B. 

Right  amount  of  time 

17 

74 

part  of  the  course? 

C. 

Not  enough  time 

5 

22  ■ 

10. 

Do  you  think  this  course 

A. 

Yes 

8 

35 

will  help  you  to  advance 

B. 

Not  sure 

13 

57 

in  rate? 

C. 

No 

2 

8 

11. 

How  do  you  feel  about 

A 

t\  . 

Like  a lot 

8 

35 

following  JPA  directions 

B. 

Like  a little 

7 

30 

instead  of  making  your 

C. 

Neither  like  nor  dislike 

5 

22 

own  maintenance  decisions? 

D. 

Dislike  a little 

1 

4 

E. 

Dislike  a lot 

2 

9 

12. 

How  much  did  this  JPA 

A. 

A lot 

17 

74 

Training  Course  help  you 

B. 

A little 

5 

22 

learn  to  follow'  JPA 

C. 

Hardly  any 

0 

0 

directions? 

D. 

Not  at  all 

1 

4 

13. 

Did  the  JPA  training 

A. 

Yes 

1 

4 

materials  seem  to  get 
harder  toward  the  end 
of  the  course? 

B. 

No 

22 

96 

14. 

How  often  did  equipment 

A. 

A lot 

8 

35 

problems  keep  you  from 

B. 

A little 

11 

48 

working? 

C. 

Hardly  ever 

4 

17 

D. 

Never 

0 

0 

15. 

How  well  did  the  JPA 

A. 

Very  well 

2 

9 

Training  Course  seem  to 

B. 

O.K. 

17 

77 

be  organized? 

C. 

Poorly 

3 

14 

16. 

How  helpful  was  your 

A. 

Very  helpful 

10 

45 

instructor  to  you? 

B. 

Helpful 

10 

45 

C. 

Not  helpful 

0 

10 

17. 

How  do  you  feel  about  the 

A. 

Too  much  time 

0 

0 

amount  of  time  spent  on 

B. 

Right  amount  of  time 

16 

70 

working  with  the  actual 
equipment  rather  than 
studying  books? 

C. 

Not  enough  time 

7 

30 

18. 

Would  you  recommend  JPA 

A. 

Yes 

. 16 

70 

training  for  all  basic 

B. 

Not  sure 

5 

22 

electronics  maintenance 

C. 

No 

2 

8 

courses? 


Do  you  plan  Co  make  a career 

A. 

Yes 

4 

of  Che  Navy? 

B. 

Not  'sure 

11 

C. 

No 

8 

Do  you  feel  that  this  JPA 

A. 

Yes 

19 

Training  Course  will  help 

B. 

Not  sure 

3 

you  be  a useful  part  of 
the  Navy  maintenance  team? 

C. 

No 

1 

4 
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